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ABSTRACT 

This report is the second of two volumes which 
document the research and analysis project that resulted in the 
development of Instructor Support Feature (ISF) Guidelines. These 
guidelines are intended to aid operational users from the Air Force, 
major commands, Simulator Systems Program Office procurement 
personnel, and contractors in the development and procurement of 
instructor support systems for future aircrew training devices 
(ATDs). The first of four sections in this volxme introduces the 
contents and purpose of these guidelines and provides an overview of 
their background and development. The second section explains the 
concept of the Instructor Support System (ISS) and the functions it 
serves, while the third presents a systematic approach for the 
selection of instructor support features. Intended for use during 
system development, the fourth section presents and discusses a 
format for providing the operational information needed to implement 
the instructor support system features selected. Also included are: a 
list of six primary references; a glossary of terms; a list of 
abbreviations and acronyms; a subject index to the report; and seven 
appendices. Appended materials include a list of documents pertaining 
to specific aircrew training devices; a four-page bibliography; a 
sample specification illustrating the use of these guidelines; a list 
of training sites visited with dates; a task commonality analysis; 
and samples of two basic task module types — flight and procedural. 
(DJR) 
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SUMMARY 



This report doctuneuts the research and analysis project that resulted In 
the development of Instructor Support Feature (iSP) Guidelines* The 
guidelines are Intended to aid operational users from the Air Force major 
commands, Simulator Systems Program Office procurement personnel, and 
contractors in the development and procurement of Instructor support systems 
for future aircrew training devices (ATDs)* During the 12-month technical 
effort, the Guidelines content and format were defined, data were collected 
and analy2ed for Inclusion within the Guidelines, and the Guidelines document 
was written* Thirteen advanced Instructional systems and ATDs provided data 
for Identification and definition of ISF requirements* Volume I documents the 
research and development effort and presents methodology, results, conclu- 
sions, and recommendations. Volume II contains the ISF Guidelines, The ISF 
Guidelines Is a ''living" document • The current version of the Guidelines can 
be obtained from the Simulator Systems Program Office, ASD/WEE, 
Wright-Patterson APB, OH. 
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PREFACE 



This document Is the final report of the Performance Measurement System 
(PMS) Guidelines for Aircrew Training Devices (ATDs) project conducted under 
Contract Number F33615-84-C-0054, sponsored by the Air Force Human Resources 
Laboratory (AFHRL) • The project focused on the development of the Instructor 
Support Feature Guidelines to aid in the specification of requirements for ATD 
acquisitions. 

Drs. Wayne Waag and Gary Thiomas of AFHRL/OT provided technical direction 
during the course of the study. Mr. Craig McLean and his staff at the Simulator 
Systems Program Office made valuable contributions to the contents of the 
Instructor Support Feature Guidelines. 

The authors wish to expres/:^ cbclr gratitude to the many operational 
personnel at the training sites visited for their time and assistance. Their 
input greatly added to the operational validity of this report. 
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SECTION I 
OVERVIEW 



Introduction Aircrew training devices may be conceptualized as consisting of 
two main components: the simulation system and the instructional 
system. Within the simulation component, the major issue is 
fidelity. In other words, to what extent should the training 
situation be a faithful reproduction of the aircraft and the 
flight environment? To date, the majority of R & D efforts 
have focused on this component. 

The other component, the instructional system, is what makes 
the simulator a training device. It consists of those 
capabilities specifically designed to enhance the training 
process by providing instructor support features (ISFs) . The 
purpose of these features is to increase the instructor ' s 
efficiency and effectiveness by reducing the workload involved 
in conducting the training exercise. Thus through the 
implementation of a set of such features, the instructor is 
freed to devote more of his attention to the training function. 

However, attempts to develop and provide a comprehensive 
instructional system have sometimes created more problems for 
the instructor than solutions. Attempts to build ATDs with 
features to support every possible aspect of instruction have 
often resulted in instructional systems, including 
instructor/operator stations (lOSs), which are difficult if 
not impossible to understand and use. Such systems often have 
not been developed according to user specified needs. These 
attempts have been overenthusiastic and premature. 

The instructional system has more recently been the focus of 
several development efforts. In particular, advanced systems 
have been developed in which traditional instructor support 
features (ISFs) have been enhanced and new features have been 
added. These efforts are based on user defined needs, lessons 
learned from existing instructional systems, and state-of-the-art 
training technology. The resulting systems, with expanded and 
enhanced ISFs, are referred to as Instructor Support Systems 
(ISSs). 



The purpose of the "ISF Guidelines" is to effectively transition 
lessons learned from the advanced systems into the operational 
training environment. It is anticipated that through these 
guidelines effective communication among operational users, 
procurement personnel, and system developers can be established. 
By promoting a better understanding of what instructor support 
features can provide, and by providing a means to communicate 
operational needs, it is hoped that these guidelines will 
help to avoid the. pitfalls of the past. 
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A second major purpose of these guidelines is to emphasize the 
importance of specifying instructional systems on the basis of 
functio nality rather than technology . The definitions and 
recoTninendations made throughout these guidelines are based on 
the functional needs of the instructor and are not made in 
terms of the current, "state-of-the-art" technology. Hardware 
and software technology is changing at an accelerating rate. 
Over-specification on the basis of today's technology can 
unnecessarily restrict tomorrow's design. Specification of 
functionality and performance from a user's perspective is 
imperative to allow contractor latitude in providing SimSPO 
with a spectrum of alternatives which will maximize the 
application of current technological advances and current 
standards . 



How to use 
this 

document 



Section I 



Section II 



This document is organized into four sections: 

I. Overview, 

II. Instructor Support Features, 

III. Selecting Instructor Support Features, and 

IV. Providing Operational Information. 

The document is not designed to be read from cover to cover. 
Rather, the sections are intended for different users at 
different times in the ATD procurement process. 

The remainder of Section I introduces the contents and purpose, 
the background and the development of these guidelines. 

Section 11, "Instructor Support Features^" explains the concept 
of the ISS and the functions it serves. A set of definitions 
of instructor support features is provided. The information 
in this section is important to those tasked with laying out 
initial ISS requirements, to those tasked with developing the 
System Specification, and finally, to those involved in system 
development. Intended users of Section II include Operational 
personnel at the using comma:^id, MAJCOM personnel, SimSPO 
personnel, and finally, contracting personnel involved in system 
development. 
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SECTION I 
OVERVIEW 



Section III Section III Is entitled "Selecting Instructor Support Features 

It guides the reader through a procedure to analyze instructor 
support requirements. This procedure should form the basis for 
the selection of instructor support features in the development 
of the specification for the ISS. Intended users of Section 
HI are those tasked with developing a Statement of Need, the 
Syst:em Specification, and ultimately the ISS. 



Section IV Section IV, "Providing Operational Information ';m is intended 
to be used during system development. If instructor support 
features are to be programmed into an ATD system, then certain 
specific operational information must be provided to implement 
these features. This information must be provided by prospective 
Operational Users of the ATD to ensure that the resulting ISS 
is tailored to their unique requirements, A format for providing 
this information is discussed and provided. 



Background In 1981 the Simulator Systems Program Office (SimSPO) of the 
Aeronautical Systems Division (ASD) stated a need for enhancing 
the instructor's capability to assess student performance in 
ATDs. The need for improved instructional capabilities within 
ATDs was also clearly identified by the Defense Science Board 
1982 Summer Panel Study Report on Training and Training 
Technology. 

Prototype training systems have demonstrated the utility of 
features which provide thq instructor with greater ability to 
control and monitor student activity and therefore make 
simulators more effective training systems. These systems have 
much to offer insofar as lessons learned during their 
development, test and evaluation, and operation, A means for 
capitalizing upon these lessons learned and introducing proven 
technology into the operational environment was sought. 
Development of a set of guidelines addressing the design, 
development, and incorporation of instructional capabilities 
within ATDs was the proposed solution. 



Development 
of the 
Guidelines 



The development of the guidelines took place in several steps. 
The first was the collection and review of a large number of 
documents , Documentation collected and reviewed included 
training documents and syllabi from nine aircrew training 
programs, relevant sections from recent ATD specifications, and 
research and informational literature on the use (and failure 
of use) of instructor support features incorporated into 
operational and research based ATDs. Over 100 documents 
were reviewed for the final version of the guidelines (Appendices 
A and B). 
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A series of meetings were held with SimSPO and MAJCOM personnel, 
including instructors and training requirements personnel, 
to determine ATD specification requirements . Meetings were 
also held with an Operational Using Command during the 
development of a sample specification (Appendix C) . 

Data were also gathered during a series of data collection 
trips to operational ATD sites and prototype ISS sites (Appendix 
D) . At least one representative site was selected for each 
MAJCOM, During each site visit ATD training requirements, 
including aircrew training objectives, simulator characteristics, 
and instructor control and informational requirements were 
collected and assessed. Visits to prototype systems supplied 
information on lessons learned in the use of instructional 
features . Survey results cited throughout these guidelines 
refer to the collection of this data and also to surveys 
reviewed during the first phase of the guidelines development. 

Finally, a conuaonality analysis was performed to determine the 
types of taslcs trained across the surveyed ATD sites and the 
prototype ISS systems . The results of this analysis are 
presented in Appendix E. 
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SECTION II 

INSTRUCTOR SUPPORT FEATURES 



Introduction 



Design to 
User Meeds 



Purpose 



The purpose of the Instructor Support System (ISS) is to 
transform the simulator into a more effective training device. 
The ISS consists of the set of instructor support features (ISFs) 
present in the simulator. Through the implementation of a 
carefully selected set of ISFs, the ISS increases the 
instructor ' s ef f ic iency and effectiveness by reducing the 
workload and providing support in the total instructional 
process of simulator training. This includes exercise 
preparat ion » s imulator control , performance measurement and 
recording, and student performance feedback both during training 
and during debriefing. Through the presence of an ISS, the 
instructor may devote more attention to providing personal, 
high quality, one-on-one instruction, rather than dividing his 
time among the student and countless other required activities. 



A properly designed ISS is responsive to user needs. In the 
past, some attempts to design a comprehensive instructional 
system have created more problems for the instructor than 
solutions . Instructor Support System designs based on 
specifications of a set of features to support every possible 
aspect of instruction are not based on functionality. They are 
not based on an analysis of the instructor's needs. Such 
dc3signs can result in an instructional system which is difficult 
to use and understand, improperly tailored to the training 
application, and difficult to keep concurrent with training 
requirements. 

The goal of this document is to guide the reader through a 
process of selecting ins true tor support features based on 
function and required training needs. Therefore, the definitions 
of features provided here emphasize function and are not 
intended to reference hardware, software or human factors 
engineering considerations. 



The first step in the proper design of an ISS is to ensure that 
all personnel involved in the specification process have a 
clear understanding of what each feature is, and what it is 
not. The purpose of this section is to present a set of clearly 
defined ISFs . The definitions included here are stated in 
operational terms to facilitate the decision as to when a 
particular feature will properly support the required training 
function. In addition to the operational definition, the purpose, 
additional considerations , related features , examples , lessons 
learned, and a specification oriented definition are also 
provided in the description of each feature. This information 
is provided to promote clear coimnunicatlon among operational 
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SECTION II 

INSTRUCTOR SUPPORT FEATURES 



personnel stating training requirements , procurement personnel 
involved in final specification definition, and contracting 
personnel involved in system development. 



Organization The ISF definitions are organized according to instructor 
of Section II function and presented iti the order they would most likely 



be used by an instruccor proceeding through a training exercise. 
This order is also used to facilitate the use of this section 
by those readers stepping chfough the procedure to select ISPs 
presented in Section III, The features are presented as follows: 

Pre«Trainlng Requirements 

o Instructor Training 
ISF: Tucorial 

o Briefing 

ISF: Briefing Utilities 

Training Reauireynent? 

o Control Function 



ISFs: Scenario Control 

Initial CotidiCions 

Real-Time Simulation Variables Control 

Malfunction control 

Reposition 



o 



Monitor Function 

ISFs: lOS Display control and Formatting 
Procedures Monitoring 



o 



Instruct Funccion 
ISFs: Freeze 



Simulator Record/Replay 
Aucomated Simulator Demonstration 



o 



Evaluate Funccion 

ISFs: Aucomated Performance Measurement 



Post^Training Requlremencs 



o 



Debrief Function 

ISFs: Hardcopy/Printout 

Remote Graphics Replay 



o 



i Function 

ISF: Daca Storage and Analysis 
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Format The section describing each ISF contains the followine: 

of ISF ^ 
Descriptions 

o DefinitloT> : Stated in functional terms. 



o Purpose and Intended Use: Stated in operational terms. 
Further describes each feature. This section can also be 
used when justification and rationale for inclusion of a 
feature are desired, 

o Additional Consi derations; Important additional points to 
consider when including this feature. These points also 
will help to "fine tune" the feature to the current training 
application. 

o Related ISFs; ISFs that can affect or be affected by the 
inclusion of the present feature. 

o g?;^niplg.g Examples of the operational use of this feature. 

o Lessons, Learned : Experiences gained (positive and negative) 
from the use of this feature in operational settings. 
Please note that readers with further lessons learned 
are encouraged to forward them to SimSPO to be added to 
this document. In this way the Guidelines will continue 
to be kept up to date on experience with ISFs in operational 
applications. 

o AID,?.P?<?j,f jlcatLqn;. A definition of this feature stated in 
language that can incorporated into a specification. It 
should be noted that this is a suggested wording. If 
"fine tuning" of the feature is required (e.g., as a result 
of additional considerations)^ the ATD specification should 
be restated to reflect these needs. 
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INSTRUCTOR SUPPORT FEATURES 
Tutorial 



Feature 



Tutorial 



Definition 



This feature provides the instructor/student with self -paced 
and self-adralnlstered programmed Instruction on the capabilities 
and use of the flight simulator and Its instructional support 
features . 



Purpose and 
Intended Use 



A problem noted In several ATD surveys is that most simulator 
Instructors are not aware of all of the functions including the 
Instructional support features available to operate the ATD. 
In many cases, the full capability of a device is not being 
utilized due to lack of knowledge and understanding. This is 
unfortunate because system operating functions and instructional 
support features , properly designed and Implemented, can 
significantly relieve instructors of routine and non-productive 
tasks . 



Additional 
Consider- 
ations 



A built-in tutorial for system operation aids in the overall 
understanding and acceptance of the system for now Instructors 
while providing valuable hands-on training. It also helps the 
intermittent user by providing on-line guidance for "refresh- 
er training". 

If self -practice is an objective of the ATD, then this feature 
may also be used by the student. 

Tutorial designs should take into consideration the following; 

o Help yupctiop. A "help** function which can be readily 
accessed during an exercise can provide valuable system 
Infoxnnation about individual capabilities of the system and 
training objective descriptions. The HELP feature is 
Intended for the user who already has a basic knowledge of 
the system and wishes to review a specific area of the ISS 
during runtime. 

o Tutorial. A complete tutorial which gives a step -by- step 
Introduction to all the capabilities of the simulator can be 
conducted at the Instructor console to provide hands-on 
experience. However , it is highly desirable that this 
feature be conducted on similar equipment such as a remote 
brief ing/ debriefing console. Using a remote console for the 
tutorial frees the simulator for continuing training and 
does not detract from the self -paced advantages of a tutorial. 
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Modification and Update of Tutorial . Due to the fact that 
ATDs are often changed and updated, tutorial procedures should 
be modifiable. The use of a data base conunon to the actual 
system (e.g. » common use of the display of a procedure or a 
graphic depletion of a SID) would provide simulator and 
tutorial concurrency. 



Related ISFs All instructional features should be covered by the tutorial. 



Example 



An instructor completed his training on how to use the ATD 
several weeks ago and hasn't yet used It with a student. Since 
he Is scheduled with his first student In a few days, he 
utilizes a remote console to obtain some refresher training. 
He employs the tutorial feature In a refresher mode to ensure 
that he Is prepared to efficiently operate the ATD in support 
of the scheduled training period. 



Lessens 
Learned 



Help functions have been Incorporated Into a recently Installed 
operational system. Although not enough operational data has 
been collected to provide lessons learned, the initial Instructor 
response at Implementation was very positive. 

When Instructors have been surveyed as to the potential training 
value of a tutorial, they have rated It very highly. The 
maximum potential of ATDs Will only be attained when instruc- 
tors are provided with the proper training in the usage of the 
simulator and its instructional features are part of the total 
training system. A built-in system tutorial is a step In this 
direction. 



ATD Specifi- 
cation 



The tutorial feature shall provide the instructor/student with 
a user-friendly. Interactive, self -paced and self- administered 
program of instruction on the capabilities and use of the 
flight simulator and its Instructional support features. The 
tutorial feature shall include a ••help" function in the form of 
an easily accessible prompt. The tutorial design shall result 
in step-by-step Instruction and shall be provided off-line at a 
remote console or at the lOS. On-line Instructional system 
operation shall also be provided (for the novice or infrequent 
user) and be accessible to the user as required. 
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INSTRUCTOR SUPPORT FEATURES 
Briefing Utilities 



Feature 
Definition 



Briefing Utilities 



Briefing utilities are any aids provided by an ATD which are 
designed to assist the Instructor in briefing a student for an 
upcoming simulator session. 



Purpose and 
Intended Use 



The main purpose of the briefing Is to prepare both the student 
and instructor for a particular exercise, This is normally 
accomplished by reviewing the student's past performance, his 
readiness for the upcoming event, and a review of the training 
objectives to be accomplished, Typical materials used are 
lesson guides, training program outlines, Instructor guides, 
and student (ATD) training records. Briefings can be improved 
by the inclusion of a briefing utility which will provide those 
materials mentioned. This is normally accomplished on a CRT 
with both alphanumeric and graphics capabilities. 



Additional 
Consider- 
ations 



If the Briefing Utility Is selected, then the following addi- 
tional considerations should be specified. 

o The Briefing Utility should be accessed via a separate 
console away from the lOS so as not to interfere with an 
exercise which may be In progress. Providing a separate 
console will eliminate any scheduling conflicts, thus not 
taking away any valuable "hands on" time. On some existing 
systems, this console serves the dual purpose of briefing and 
debriefing when a remote graphics capability exists. 

o It is important that the method of interaction with the 
briefing utility be as similar as possible to the main lOS. 
This will ensure ins^tructor familiarity with the device. It 
must be user- friendly . For example, the briefing material,] 
required to cover the training objectives for a particular 
ATD may be very extensive. These materials must be easily 
accessed and functionally grouped in user terms or this 
feature may become cumbersome to use. The data and displays 
should be identical to realtime data wherever possible. For 
example, approaches and departures shown at a briefing station 
should look identical to corresponding lOS displays during 
the exercise. 

o It is most Important that briefing data be easily modifiable. 
Procedures and flight profiles change routinely. Briefing 
materials which cover these objectives must be up-to-date , 
or they are of little value. An automated means of updating 
the material should be provided. 
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INSTRUCTOR SUPPORT FEATURES 
Briefing Utilities 



o Briefing for Instructorless Training: With more sophisticated 
software and hardware, briefings may be presented without an 
instructor. Computer -assisted interactive briefings would be 
especially appropriate for simulators v^hich allow unsuper- 
vised practice or when there is a need to otherwise reduce 
instructor workload. 



Related ISFs Scenario Control . Scenario Control should be related to the 
briefing utility for efficient accessibility. By selecting a 
particular scenario for review during the briefing process, the 
instructor would have available the training objectives for that 
particular exercise and any other pertinent information 
(e.g., threat characteristics during the ingress leg of an 
interdiction mission). 

Automated Perf'ormance Measurement . If the ATD has an automated 
performance measurement feature , then the algorithms, measurement 
criteria , and any other information relevant to this feature 
should be made available via the briefing utility. This will 
provide an insight as to the method of measurement and will 
help in the general understanding and user acceptance of 
automated performance measurement. 

Data Storage and Analysis . If the ATD has a data storage and 
analysis feature which records performance and retains this 
information by student, the instructor should be able to 
access this information by student name or number via the 
Briefing Utility. In this way, both the student and instructor 
will be informed of the student's progress and previous 
performance. 



Examples An instructor and student scheduled for a formal syllabus trainer 

event would arrive at the facility in time for the briefing. 
They would proceed to a Briefing/Debriefing console and log on 
to the system. The instructor would then select the syllabus 
event. The Briefing Utility would display an outline of the 
exercise. From here the instructor would have access to the 
training objectives, performance criteria, and any other 
pertinent information. If the system had a data storage 
and analysis feature, he would have the option of reviewing the 
student's previous performance. 

If the upcoming event were not part of a formal syllabus, the 
instructor may still access the briefing utility and review 
briefing materials by training objective and or other subject 
headings, e.g., "aircraft system descriptions/' 
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INSTRUCTOR SUPPORT FEATURES 
Briefing Utilities 



Lessons The use of prerecorded briefings has been attempted In Isolated 

Learned circumstances r however, surveys have revealed that Instructors 

believe this feature Is unnecessary and prefer to brief students 

themselves. 

Briefing materials should be modified and updated reliably and 
efficiently as needed. This will encourage use of the briefing 
utility, A positive result would be to provide standardization 
at the briefing level. Unfortunately, some existing devices 
with a Briefing Utility have not been updated, and therefore the 
positive aspects of this feature have been lost. 



ATD Speclfl- Briefing utility aids shall be designed to assist the instructor 
cation In briefing a student for an upcoming simulator session. The 

aids shall prepare both the student and instructor prior to a 
particular exercise and consist of the following materials: 
lesson guides, training program outlines, instructor guides, and 
student training records. The aid shall serve as a briefing 
and debriefing utility accessed on an off-line remote graphics 
console , The method of Interaction shall be similar to the 
main lOS and shall be easily accessible by the instructor. 
Presentation materials shall be functionally grouped In user 
terms to ensure optimal usability and easy modlfiablllty for 
future update. 
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INSTRUCTOR SUPPORT FEATURES 
Scennrlo C«;>r|*:r^'l 



Feacure 



Scenario Control 



Definition 



Purpose and 
Intended Use 



Additional 
Cons Ider- 
atlons 



The Scenario Control feature supports the Instructor by 
controlling the ATD to meet established training criteria. 
This feature configures and controls the ATD to accomplish 
specific training objectives. The objectives are activated in a 
predefined order and under p respeclfled conditions. 

During the conduct of an exercise, instructor workload is divided 
among providing instruction in the form of explanations and 
feedback to the student, monitoring and evaluating student 
performance, and controlling the simulator. The purpose of 
scenario control is to relieve some of this workload by the 
automation of certain ATD control inputs and by automatically 
presenting Information which is appropriate to the current 
training objective. 

When training is conducted with scenario control, a properly 
constructed ISS can determine where the student is in the 
training exercise. This allows the ISS to present appropriate 
displays and graphics to the instructor at appropriate times 
It also allows the ISS to automate the control of simulation 
variables. For example, at the beginning of certain training 
objectives, environmental conditions may require change 
Rather than requiring instructor input at these times, the ISS 
may automatically reinitialize those variables. In sum, under 
scenario control it is possible to automate wherever possible 
those tasks which do not directly relate to person al instruction. 

L?v?lg of Automation of scenari o Control There are varying 
levels of automation of scenario control. The level that 
should be selected will depend on the nature of the training to 
be conducted on the ATD. The levels are described below: 

c Fully Automated Scenario Control. Fully automated scenario 
control is equivalent to a totally preprogrammed mission 
scenario. This level of scenario control automatically 
controls an entire exercise (e.g., cross-county navigation 
flight, strike mission with high and low altitude segments, 
etc.). To use fully automated scenario control, the 
instructor must simply select a specific scenario at the 
beginning of the training exercise. The ATD will be 
automatically programmed for the entire exercise. All Inputs 
usually required from the instructor during the exercise 
(e.g., environmental conditions, malfunctions, checklists, 
threat, departure and arrival facilities, enroute way points. 
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INSTRUCTOR SUPPORT FEATURES 
ScenatLio Concrol 



display content, display options, etc. ) are automatically 
prograwitied to occur when specific conditions have been met. 

This type of control is supportive of a formalized training 
syllabus, ins tructor less training, and trainer events 
requiring rigid standardization requirements, 

o Semi - Automated Scenario Control. Semi-automated scenario 
control is designed to provide the instructor with some 
flexibility during the exercise, A specific scenario is 
selected in preparation for the training exercise identically 
to the fully automated mode. However, inputs during the 
exercise may be selectable (e.g., activating a malfunction 
from a pre-selected list), they may be modified or overridden 
(e.g., removing a SAM threat from a battle scenario), or 
messages may be presented informing the instructor that inputs 
are about to be made and confirmation is requested prior to 
activation (e.g., reducing visibility to field minimtuns) . 

This type of control is supportive of continuation training 
where the exercise requires "real-timB" tailoring to conform 
to student needs. 

o Scenario Control by Objective. Scenario control by objective 
requires the instructor to pre-select specific training 
objectives prior to an exercise. These objectives will be 
made readily available to the instiructor during the exercise 
for manual selection. When selecte<:. displays appropriate 
to the training objective will be automatical' 7 displayed, and 
variables such as environmental conditions relative to the 
training objective will be automatically set. 

This type of control is supportive of specialized part- task 
training or training s"" •^uations which require instructor 
flexibility. 



Related ISFs Ji^^t^iaJ. g<>nd^tlons . The initial conditions at the beginning of 
a scenario should be ma i part of this feature such that when a 
specific scenario is selected, the initial conditions will be 
automatically set when the exercise is started. 

Automate^ Pepfortnance Measurement , In a well-des igned ISS, the 
performance n»' isurement computer programs are directly linked 
to and run concurrently with the scenario control feature. 

p^a^-'tj.me .Slm *^ tj.on Variables Coptyol . These variables may 
be preprograiumed to be Inserted automatically if desired. 
Simulation variables may also be grouped according to the 
active objective and made readily available for instructor 
activation or adjustment. 
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INSTRUCTOR SUPPORT FEATURES 
Scenario Control 



Examples Fully Automated Scenario ControJL . The following is an 

operational description of an instrument training exercise at 
the undergraduate level. The student will: 

o Take off from a training base via a standard instrument 
departure (SID) 

o Fly an instrument "round robin" in the jet route structure, 
to arrive back at his departure field 

o Fly a jet penetration with an XLS final to minimums 

o Execute a missed approach at tnininitiins 

o Terminate the exercise by flying a GCA precision final 

o Demonstrate his knowledge of the normal checklist procedures 

o Demonstrate his knowledge of the procedures covering the 
electrical system malfunctions 

This exercise can be conducted under fully automated scenario 
control. Table II-l presents a list of the task objectives 
which would be automatically tracked by the ISS , The appropriate 
displays and required simulation variables control are also 
presented. As the student flies the scenario^ these displays 
are automatically p: jiiented and the variables are automatically 
initialized as the student enters the phase of the scenario 
related to each task objective. 

Semi r Automated Sc enario Control . Under semi- automated scenario 
control, the same displays and variables control would occur 
for each phase of the exercise. The instructor would be given 
options at each phase, however, to select, modify, or cancel 
the automated inputs. This would give the instructor more 
control over the simulator exercise than in the fully automated 
case described above. 

Scenario Control by Objective. Scenario control by objective 
would be used in a part-task training situation. For example 
the training objective could be a GCA Precision Final to Williams 
AFB (See training objective listed in Table II-l). Using this 
type of scenario control, the instructor could repeatedly ask 
the student to perform the task objective. Each time the 
student repeats the task, the instructor would reselect the 
appropriate objective and the ISS would present the appropriate 
displays (Glideslope/centerline and historic trail of A/C) and 
reinitialize the simulator variables (Set Wx to abovcs minimums). 
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INSTRUCTOR SUPPORT 
Scenario Control 



Lessons Canned exercises which provide fully automated scenario control 

Learned have been Incorporated in ATDs and have been useful in certain 

specific training applications. These are usually limited to 

standardization/evaluation exercises , instructorless training. 

and a certain undergraduate level of training where there is a 

formalized syllabus. 

A great part of the training conducted on ATDs requires a more 
flexible control , however . Tailoring an exercise to an 
individual's need is often a basic operational requirement. A 
semi -automated level '^f control or control by objective would 
allow for modificai to the scenario (e.g., reset back or 

foirward in a mission profile, delay or delete a malfunction,) 
and to allow for TOcdlf ications to the simulation variables 
(e.g., change weather at a destination field) during an exercise 
without having to re -initialize the system to some other 
operational mode. 

For every level of scenario control a means should be specified 
for the instructor to review scenarios before selection to see 
exactly what objectives are to be perfomed and to determine 
how the scenario will develop. The instructor should also be 
able to review the scenarios via the remote briefing/debriefing 
console if one exists. 

Finally, for any type of scenario control, the scenarios should 
be relatively easy to create and to modify, the basic system 
design should acknowledge that training requirements change, 
and provide for modifications of preprogrammed scenarios 
accordingly. 



ATD Specifi- The Scenario Control feature shall support the instructor by 
cation controlling the ATD to meet established training criteria. 

This feature shall configure and control the ATD to accomplish 
specific training objectives. The objectives shall be activated 
during training in a predefined order and under prespecified 
conditions . 
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TABLE II- 1 
SCENARIO TABLE 



TASK MODULE NAME 


DISPLAY CONTROL 


VARIABLES CONTROJ. 


Takeoff Checklisc 


Display of checklist 
with updated student 
actions . 




Takeoff 


Display visual scene. 
Cockpit instrument 
information. 


Set environmental 

conditions, 

Wx & Winds, 


SID No * from 
Williams AFB. 


Display of departure. 
Historic trail of A/C. 


Set cruise winds. 


Leg A to B 


Display of Jet Route 
structure . Historic 
trail of A/C. 




Leg B to C 
• 


Display of Jet Route 
structure , Historic 
trail of A/C. 




Top' C T\ 


Display of Jet Route 
structure , Historic 
trail of A/C. 




Descent Checklist 


Display of checklist 
with undate of <;tiid#>nt" 
actions . 




HI TACAN No. 1 
Williams AFB 


Display of approach 
Historic trail of a/C 


Set landing winds. 
Set runway lights. 
Wx to below 
field mlnlmums. 



Landing Checklist Display of checklist 

with updated student 
actions . 
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TABLE II -1 
SCENARIO TABLE (Continued) 



ILS approach to 


Display of glideslope/ 
centerllne Historic 
trail of A/C. 




Missed Approach 
ac w 11 J. lams {\r D 


Display of missed 

ar>m"na<^H Hi Qtoric 

trail of A/C. 




GCA Precision Final 
to Williams AFB 


Display of glideslope/ 
centerline . Historic 
trail of A/C. 


Set Wx to above 
field minimums. 


Landing Checklist 


Display of checklist 
with updated student 
actions. 






Generator Failure 


Display of emergency 
procedure with updated 
student actions. 




D.C. Buss Failure 


Display of emergency 
procedure with updated 
student actions . 
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INSTRUCTOR SUPPORT FEATURES 
Initial Conditions 



Feature Initial Condir.ions 



This feature enables the instructor to set initial values for 
many parameters within the simulation. Initial values for 
environmental factors such as wind, turbulence, visibility, 
etc. and vehicle dynamics such as altitude, airspeed, position! 
weapons load and fuel can be established before the training 
session (during lesson initialization procedures) or during the 
training session (by calling up by the reset facility). 



Purpose and The primary value of the initialization/reset capability is 
Intended Use that it enables the instructor to devote his time to instruction 
rather than inserting variables which have been predefined 



Additional o For any moderately complex simulator, it is necessary that a 
Consider- library of initial conditions be stored for use in actual 

training sessions. The number of initial conditions varies 
according to the training requirements specific to that 
device. 



o The instructor should be able to review the initial conditions 
before executing them, to see exactly what conditions are 
specified and to determine how the training activity will 
develop. To add flexibility, he should also be able to modify 
the prestored data before execution (and save it for later use 
if desired), so that a particular lesson could be tailored 
to the training situation. 



^^^^ S-C-epar j,Q Cot^<;yo^ . If a scenario control feature is specified for 
a specific ATD, then the initial condition sets may be incor- 
porated as part of this feature. 

IP . t^fll Sygg?lB Frgeg? . The state of the simulator should be in 
total system freeze while the initialization process is being 
conducted. This will allow the student to reorient himself 
with respect to this new configuration. The freeze condition 
may then be removed by instructor control. 



Example After reviewing the student's records; the instructor decides 

that several of the predefined values for scenario conditions 
need revising to make the scenarios more challenging. He then 
makes the appropriate changes so that he is not burdened with 
this task during the training session. 
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INSTRUCTOR SUPPORT FEATURES 
Initial Conditions 



Lessons Because the l.C. reset is often-used method to reposition the ATD 

Learned to a specific point within the training scenario, it should be 

designed so as not to be restrictive, time consuming and 

difficult to access. 



A.TD Specifi- Initial conditions feature shall enable the instructor to set 
cation initial values for a set of parameters which shall define a 

starting point for a mission scenario. 

Parameters whose values are set shall include the following 
types : 

a. Air vehicle configuration 

b. Air field and runway characteristics 

c. Radio/navigation aids 

d. Environmental conditions 

e. Air vehicle flight characteristics 

The initial conditions sets shall include preprogrammed sets and 
programmable sets capable of temporary storage, modification 
and recall of pre-selected parameters. 

Initial conditions sets shall be created off-line and stored 
for call-up by the instructor at the beginning of a mission 
scenario. An on-line capability shall also exist for temporary 
modification, review and recall of pre-selected values during the 
training session. 
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INSTRUCTOR SUPPORT FEATURES 

Real-Time Simulation Variables Control 



Feature Real-Time Simulation Variables Control 



Definition This feature provides control for the insertion, removal, and 
alteration of simulation variables while the simulator is in 
operation. The simulation variables include such variables as 
environmental conditions ; aircraft configuration , maneuvering , 
and positioning (ovnshlp, vingmen, and adversary); target data; 
airfield data; and threat data. The methods of control range 
from complete automation where no instructor action is necessary, 
to manual selection from a set of variables which have been 
grouped according to the needs of a particular exercise. The 
degree of automation depends on the training application and 
requirements. Control by continuous interaction via an input 
device is also Included. 

Purpose and Control of the simulation variables can be provided through 
Intended Use several different instructoa: support features In addition to 
this feature. For example, Reposition offers control of aircraft 
position parameters; Malfunction Control offers the instructor 
control over Insertion of malfunctions; Initial Conditions 
provides for the setting of initial conditions; and Scenario 
Control offers several levels of automation in the control of 
these variables , Therefore, simulation variables control 
should be specified when control of certain variables is not 
adequately covered by means of any of the features identified 
above , 



Additional o Controlling the simulation variables in a completely 
Consider* automated mode, In a semi-automated mode, and by objective 

atlons are covered under the discussion of scenario control. 

See the definition of Scenario Control in this section. 

o Another potential means of control is continuously through 
an interactive device at the instructor console. This is 
the means that would be employed to control the movement 
or position of other aircraft or surface vehicles. For 
example, control of the target could be by movement of a 
cursor over a graphics display. 

o Finally manual control may be required In specific 
Instances. If ao, access to these controls should be 
made convenient by functional grouping according to the 
active training objectives. 
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INSTRUCTOR SUPPORT FEATURES 

pp«1-Ttme S lrniilatlon Variables Contr.o.; 



Related ISFs ftn^o^..r.d P^rfortnance Measurement. The sinulation ^^J^jJ^ff ^° 
Sr controlled may impact task difficulty. This would directly 
affect the performance measurement output and should be made 
' explicitly clear to instructors as the results of the performance 
measurement are presented to him. 

p^P».T^Mo,1 . Malfunc f ^on Control. Initial . CondUlon?. . a . n^ 
flrp.narto Control . These features are also means of offering the 
instructor control of the simulation variables in real-time. 
See discussion under "Purpose and Intended Use." 



Example 



An instructor may activate and position an airborne adversary 
by positioning the cursor over a graphic depiction of a hostile 
environment . 



Lessons 
Learned 



It was observed that the manual selection of the simulation 
variables is best suited for informal training, e.g., contin- 
uation training. This feature was available on all of the 
systems visited. The amount of usage depended on the 
accessibility of the variable and whether it had any training 
value with respect to the objectives being taught. 

Using the preprogrammed sets of initial conditions to control 
simulation variables has been observed. However, the selection 
of variables by "re- initializing" the simulator seemed to break 
the flow of training and detracted from the realism of 
flight. The initialization feature is designed primarily to set 
up the simulator at the start of an exercise. The use of 
this feature to change simulation variables during training was 
observed to be more of a "work around.'.' 



ATD Soecifi- This feature shall provide control for the insertion, removal, 
cation' and alteration of simulation variables while the simulator is 

in operation. The simulation variables shall include such 
variables as environmental conditions; aircraft configuration, 
maneuvering, and positioning (ownship, wingmen, and adversary); 
target data; airfield data; and threat data. 
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INSTRUCTOR SUPPORT FEATURES 
Malfunction Control 



Feature Malfunction Control 



Definition Malfunction Control enables the instructor to fail, partially or 
totally , simulated aircraft equipment or to introduce an 
abnormal equipment condition during the simulation in order 
to train the student in recognizing and responding to such 
malfunctions . 



Purpose and ATDs provide the student with a safe, controlled learning 
Intended Use environment for training responses to equipment malfunctions and 
resultant emergencies. Control of malfunctions can be partially 
or completely taken over by the simulation computer^ thus freeing 
the instructor for other important instructional activities . 
In addition, if malftinction control is even partially automated 
then students can practice malfunction and emergency procedures 
without the aid of an instructor. Thus students can benefit from 
additional practice whenever ATO time is available. 

Malfunction control can either be manual, partially automated or 
fully automated. Under manual control, the instructor is 
required to select and activate malfunctions as the simulator 
mission proceeds. While this method offers the instructor 
maximum flexibility in controlling malfunctions, it also imposes 
the greatest workload. Automated malfunction control includes 
several different poss ible variations . The following list 
suggests various ways malfunction control can be automated and 
the purpose of each* 

o Malfimction control can be partially automated by allowing 
the instzructor to select the set of malfunctions to be used 
in advance of the simulator mission* This preselected list 
is then made readily available during the exercise. The 
number of alternatives for selection during the mission is 
reduced while still allowing instructor control. 

o In another possible variation of partially automated control, 
the instructor may pre-select both the malfunctions to be 
used and when they should be activated. During the mission 
the instructor takes no action except to cancel or postpone 
an upcoming malfunction he has decided not to impose on the 
student . This method of selection further reduces the 
instixictor 's workload. 
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INSTRUCTOR SUPPORT FEATURES 
Malfunctio n Control 



o Under a completely automated version, malfunction control 
would be preprogrammed according to each specific simulator 
exercise in the training program. The instructor is only 
required to select the exercise. All selection and activation 
of malfunctions is predetermined and preprogrammed. Ideally, 
automated malfunction control significantly reduces the 
instructor's workload both in setting up the mission and in 
conducting it. This method also promotes standardization 
within the training program by ensuring that such lessons are 
always presented in the same way. 



Additional If Malfunction Control is selected, then the following additional 

Consider- considerations should be specified. 

ations 

o It is assumed in these guidelines that through the ISD 
process, training objectives, task listings, and media 
selection have been completed for your training program 
before the specifications for the training devices have been 
developed. Malfunctions should be included in the simulator 
based on these task listings. The decision to manually or 
automatically control the selection and activation of 
malfunctions should at least partially be based on the types 
of malfunctions that are presented In these analyses. 

o If malfunctions are to be selected by the instructor either 
before or during the simulator mission, then they should be 
presented in groups organized according to the previously 
identified tasks or training objectives. They should alsc 
correlate to the TO-1 sections for emergency procedures. 

o If malfunctions are to be automatically activated, then all 
conditions to start, stop, identify correct and incorrect 
procedures, and any other factors (e,g,, environmental 
conditions) should be identified in advance by the usinf 
command.. 

o Instructors may require the capability to cancel or postpone 
malfunctions which have been pre-selected for automatec 
insertion* To make it possible to override previously 
programmed malfunctions, the system must provide a warninj 
to the instructor that a malfunction is about to occur. 

o Whether ox not the type of malfunction control is manua! 
or automated, the instructor should be provided with a llsi 
that shows which malfunctions are presently active. Ii 
addition to the above, if in the automated mode, a mean^ 
should be provided which will preview the remaining malfunc 
tions and conditions under which they will be activated. 
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INSTRUCTOR SUPPORT FEATURES 
Malfunction Control 



lated ISFs Scenario Contr o . ; . Automated malfunction insertion and removal 
requires a real-time scenario control capability. This control 
is required for malfunction Insertion/removal because the 
conditions for Initiating the malfunction must be sensed and 
compared against Insertion/removal criteria. 

PCoceduyes Monltoyln g- Similarly, if the malfunction Is to be 
automatically removed after the student has successfully coped 
with It, a procedures monitor Is necessary for assessing when 
the correct procedures have been completed. If the malfunction 
Is CO remain In effect (e.g., engine out), then a procedures 
monitoring system designed to monitor sCudent performance must 
know this so that appropriate standards of flight performance 
can be used. 



Examples The following are examples of malfunction control: 

o HaTlu^; Cqntr-ol - During a training session the student had 
difficulty with an engine failure so the Instructor decides 
to Introduce the malfunction again later In the session for 
remediation. At an appropriate time the instructor manually 
selects and activates the engine failure. 

° ?eini-A^toJn , at^d Control . Based on his review of student 
records the Instructor decides that extra practice of the 
hydraulic system failure procedure Is needed. He therefore 
pre-selects the malfunction but does not specify when It is 
to be Inserted. This places It In a "ready" status. Later 
in the training session at a time when it does not interfere 
with other training, the instructor Introduces the hydraulic 
failure with a simple command. 

o FullY Autom.ated Control. A trainer event on airways 
navigation includes training objectives concerned with TACAN 
failure and lost communications procedures. At a predefined 
point In the route, the TACAN failure Is automatically 
Introduced. After the student has demonstrated the proper 
procedures or at a predefined point In the route, the TACAN 
Is restored. At a later point In the route the simulated 
radio failure Is introduced automatically. 



Automated malfunction control Is valuable only If It Is well 
designed. Problems have been experienced with time-based 
automated malfunction Insertion/removal since time does not 
always correlate with mission events In a meaningful way. For 
er.ample. In a tactical situaCion, particularly one with modeling 
of enemy forces and tactics, the student will be expected to 
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INSTRUCTOR SUPPORT FEATURES 
^lalfunctlon Gontr_ol 



take actions which are based upon the situation rather than the 
clocks Therefore logic- controlled automated malfunction 
insertion/removal is preferred, as long as the 1 decision 

logic is flexible enough to specify appropriate conditions 
completely. With logic-controlled procedures, it may be 
possible to specify probabilistic malfunction insertion. For 
example, under certain conditions one of a small list of 
malfunctions will occur, or under certain conditions a 
malfunction may or may not occur. 

Manual malfunction insertion tends to produce a high instructor 
workload • Therefore when manual control is specified, the 
method of selecting and activating malfunctions becomes very 
important. Grouping by objective or training taslc would help 
to reduce the workload. 

Automated malfunction control is seldom used by some groups 
of instructors who prefer manual control. Their comments 
indicate that automated malfunctions are sometimes unreliable 
and can be difficult to implement. In general, instrucLors 
prefer the flexibility to tailor training to student response and 
needs . 

As stated in the above paragraphs , there are basic problems 
with both extremes, from manual insertion, where instructor 
workload may hamper his instructional tasks, to fully automated 
which restricts his flexibility in tailoring the exercise in 
response to student needs* 

Instructional personnel should determine what malfunctions should 
be trained on the ATD to meet the training requirements. Too 
often, malfunctions are inserted to "increase the student's 
workload" without any specific training objective in mind. 
Malfunctions can then be organized in logical groups either for 
later presentation to instructors using the simulator or for 
simulator designers' and programmers' use when programming 
the simulator for automated insertion by task or training 
objective. 



ATD Specifi- Malfunction control shall provide the instructor the capability 
cation to preprogram a sequence of abnormal aircraft equipment 

conditions and/or emergency conditions before or during the 
training session. The time and number of actions required 
on the part of the instructor to select, alter, and enter 
malfunctions shall be minimized to the greatest extent possible. 
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R_ePQstt:i,ori 



Feature Reposition 



This feature provides the ability to position the ATD to a 
specific point in space that has some significance to the 
training scenario. All flight parameters vill be capable of 
adjustment to meet the new condition, and the ATD configuration 
will be automatically checked to ensure a crash condition will 
not occur as a result of repositioning. 



Purpose and This feature promotes efficient use of available training time 
Intended Use and other assets by not requiring the student to "fly" the ATD 
to the desired location. Having the ability to reposition the 
ATD to meaningful positions in the exercise will allow the 
instructor to modify the exercise to meet the student's needs. 
This can be done in an effective manner by providing reposition 
options associated with the training objectives, e.g., initial 
approach fix, final approach fix, or end of the runway after an 
aborted takeoff. 



Additional 

Consider* 

ations 



Method, of Selection. Older ATDs required lengthy manual 
procedures such as slewing to reposition the ATD, Some newer 
devices incorporate dedicated controls (usually pushbuttons) 
that instructors use to select one of several sets of 
initial conditions. Others provide lists of combinations of 
initialization options displayed on CRT display which 
allow a single selection from a readily available menu. 
Regardless of the method used, it is important that the 
method chosen does not add to the instructor workload, and 
that the selections made available are clearly labelled and 
are appropriate to the objectives being trained, 

gonfiU^yatjoTi Higmatch> If after a repositioning a crash 
condition exists, a message warning the instructor should be 
given and the device will not be moved until the configuration 
is corrected. For example, if the simulator is to be placed 
at the end of runway from a flight condition, and the landing 
gear is not down, a message will inform the instructor of the 
condition and the ATD will not be repositioned until the 
landing gear is placed down. 



Related ISFs H^ee^g, It is important that when the ATD is being repositioned, 
that the cockpit be placed in the freeze condition upon 
completion. This will allow the student time for re-orientation 
and the time of fly-ouc can be controlled by the instructor. 
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Scenario Control . If a scenario control feature exists , it 
must be made aware that the ATD Is being repositioned. 

Automated Perf^orrnapce- Measuyernent , The automated performance 
measurement feature must be aware of any repositioning and 
simulator reconfiguration during resets « By repositioning the 
simulator to the beginning of a training objective with a 
known set of conditions, an AFM can easily account for any 
modifications to a scenario and adjust accordingly. 



Example 



During a strike training mission involving a low- level navigation 
Ingress to a target, the student flies most of the route 
correctly. However , he has difficulty in flying the proper 
airspeed and altitude profile in the final portion of the route 
loading up to the target. This adversely affects his performance 
in the attack phase and degrades the training value of the 
mission. The instructor then uses the reposition feature to 
position the aircraft at a point in the route where the student 
can re-fly the final portion of the mission. 



Lessons 
Learned 



Repositioning the simulator to a specific location is used on 
all devices and is mostly used for repetitive training 
(e.g., approaches)* The most common way to reposition was 
accomplished via an 7>C. reset. It is among the most frequently 
used and highly valued features at ATD sites. It is typically 
used in conjunction with flight system freeze and permits 
Instructors to rapidly re-initialize the ATD to a particular 
configuration so that a student can repeat a particular maneuver 
or mission segment. However, if the I.C. reset is used, it 
must be designed so as not to be restrictive, time consuming, 
and difficult to access* 

The most versatile design of the reposition feature was observed 
on a device where the simulator can be positioned anywhere within 
the active geographic graphics display by identifying the 
position with a light pen* Repositioning this device may also be 
accomplished by bearing and distance from a fix, latitude/ 
longitude, or by identifying a previous position by a "snapshot 
I.e." However, this may be over-designed for the training 
requirement « 



ATD Specifi- 
cation 



The reposition feature shall have the capability to position 
the ATD at any point in the mission training scenario. All 
flight parameters shall be capable of automatic adjustment 
to meet the new condition Imposed by repositioning. After 
reposition, ATD configuration shall be automatically checked to 
preclude any crash condition or other adverse condition and 
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shall remain ir .^ freeze state until all incompatible conditions 
are corrects, t 

The reposition feature shall be designed to enhance instructor 
efficiency. The tine and the number of actions required on the 
part of the instructor to select, alter and enter data shall be 
tsinimized. 



ERIC 
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Feature 



lOS Display Control and Formatting 



Definition 



The lOS display control and formatting provides the instructor 
with a meaningful depiction of student performance during 
active mission training. The presentation of information is 
designed to be an easy- to- read, uncluttered, standardized 
format of the current status of graphical and instructional 
information, The information layout should be consistent with 
the limitations of human perception and memory in order to 
minimize user interpre tational effort, alleviate confusion 
thereby ensuring quick recognition and maximizing readability. 



Purpose and 
Intended Use 



There is a basic requirement that the instructor "knows" what 
the crew is doing throughout the training exercise. He needs 
information regarding the current status of various facets of 
the simulation exercise. An IDS display which is formatted 
based on instructor needs and training objectives provides a 
more meaningful depiction of student performance. 



Additional 
Consider- 
ations 



Mi,s,gion _S_ta_tus Displays . Computer-generated mission status 
displays can be tailored to the segment or task activity in 
progress. Some systems have switchable fields of view in the 
cockpit. Radar, for example, may use one screen for navigation 
and targeting modes. The capability to select and view modes 
independently of the student's choice allows the instructor to 
more clearly determine whether the student is using the 
appropriate mode. Such requirements should be stated clearly, 
since they may place additional demands on the computational 
system and require significantly different software designs. 

Manual versus Auco matic Display Selection . A default display for 
the active training objective should be displayed automatically. 
However , alternate displays should be made available for 
selection from a group of displays appropriate to the active 
task being conducted. 

Automatically Activated. In most cases where the aircraft is 
geographically referenced on a display, an automated feature 
can provide the correct reference. For example, in the case 
where the simulator is repositioned to the beginning of an 
approach, an approach display will automatically come up, In 
cases when a geographic plot is being displayed and when the 
aircraft flight path approaches the edge, the display would 
change to the next appropriate display. 
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Display Formats , CRT displays can present many categories of 
information very concisely. In an attempt to provide the 
greatest amount of information at one time, display formats are 
sometimes so compact and complex that the results can be 
unreadable. In preparing display formats, one should consider 
the amount and appropriateness of the data. It muse also be 
formatted for quick and accurate legibility. A "declutter" 
option also provides a method of separating "need to know" and 
"nice to know" information. 



Related ISFs: Scenario Control . Although display options do not relate 
directly to simulator control , they do provide valuable 
evaluation information. The "smart" system would know which 
training objectives were currently being performed. The 
display options appropriate to the running task could be made 
readily available (SID plates, approach places, optimum dive 
angle, single engine landing procedures, etc.). 



Examples During an instrument flight training mission, the student 

flies an IFR navigation route to an instrument approach at a 
destination airfield. During the navigation phase, actual 
aircraft track relative to the planned route is displayed to 
the instructor. The student's selections of NAVAIDs and radio 
frequencies are monitored and incorrect selections are also 
displayed to the instructor. When the student starts his 
final approach, the display formats change to provide graphic 
depictions of glideslope, lineup and airspeed parameters, and 
indications of aircraft landing configuration status. When an 
ai rc r af t sys tem malfunction occurs in the scenario , sys tem 
indicators and student control activations are displayed to 
the instructor. All of the display format changes occurred 
automatically, based on the active training tasks and instructor 
information requirements for the tasks. This graphic information 
can be recorded and later replayed during debrief. 



In the past, repeater instruments were the mechanism to satisfy 
the requirement for aircraft cockpit /control information. 
More recently, this type of information has been replaced with 
graphic displays. However, in many cases where graphics have 
been the primary method of displaying simulator configuration 
and cockpit activity, the design has been toward displaying 
anything and everything that "may" be of value. This has 
resulted in displays which are very difficult to interpret. 
The appropriate data is most likely contained on these displays: 
however, at times it is difficult to follow to evaluate student 
performance. This is especially true with the casual user. 
The most immediate user response to this design problem is to 
go back to the basic aircraft instrumentation and to lay out the 
instruments and repeaters as in the actual aircraft. This may 



Lessons 
Learned 




INSTRUCTOR SUPPORT FEATURES 

lOS Disp lay Control and Formatttng 



be a valid alternative, however, care should be taken so as to 
take advantage of this feature and the state-of-art technology. 
For example, in an exercise where the training objective is to 
fly instrument navigation, the instructor may be provided with 
the navigation Instruments to evaluate the student's 
performance. He must then interpret those instruments in order 
to know exact aircraft location, A properly designed display 
for this type of objective may provide both instrument readout 
and aircraft position with respect to a route or flight path 
being flown. 



ATD Specifi- The lOS display format shall provide the instructor with a 
cation meaningful depiction of student performance during active 

mission training. The presentation of information shall be 
an easy- to-read, uncluttered, standardized format of the 
current status of graphical and instructional information. 
The information layout shall be consistent with the limitations 
of human perception and mcvcory in order to minimize user 
interpretational effort, alleviate confusion thereby ensuring 
quick recognition and maximizing readability. 



EKLC 
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Feature 



Procedures Monitoring 



Definition 



Procedures Monitoring provides a method of monitoring student 
activity with respect to procedural performance , such as 
the accomplishment of checklist Items. This feature may also 
provide performance measurement of these items. 



Purpose and 
Intended Use 



A major focus of flight training is to teach the student about 
normal and emergency procedures specific to the aircraft 
equipment to be operated. Typically , there are numerous 
checklist procedures the student must know thoroughly. The 
simulator provides the Ideal tool to master these procedures, 
especially in the area of emergencies and system malfunctions. 
Procedures monitoring provides the instructor with the capability 
to observe and evaluate several facets of student performance 
simultaneously- It may also provide objective, standardized 
performance measurement of the student's accomplishment of 
procedural steps. A graphics display which summarizes the 
procedures attempted and procedural errors should be made an 
option to the Instructor for monitoring student activity. This 
feature is especially useful when the instructor monitors the 
exercise from an off-board station where cockpit activity 
cannot be directly observed. 



Additional 
Consider- 
ations 



Many ATDs present (on real-time displays or hardcopy printouts) 
the actual sequences in which procedures are performed by 
students. It Is the instructor's responsibility to determine 
whether or not the procedural sequences and timing are 
acceptable. State^of - the^art devices have been able to provide 
automated measurement of performance of procedural sequences. 
This has been accomplished by the development of "intelligent" 
start/stop logics which know when and what the crew is doing, 
thereby providing a more d3mamlc and accurate description of 
student performance. 

The meaningful measure of procedures requires relatively 
complicated computer measurement logics. A considerable 
and detailed task analysis must be accomplished prior to 
contractor development. Correct sequences must be determined 
in detail, and likely alternative sequences (both acceptable 
and unacceptable) must be defined so that computer measurement 
and scoring logics act fairly and do not penalize students for 
using occasional (but acceptable) departures from normal, 
textbook procedural sequences. 
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Related ISFs 



ICS Display ConCrgl and. Formatting . It Is Important that 
assessment of student performance of procedures be presented in 
an easy- to 'read- and • understand format. Among the problems 
identified about displays were 1) that the volume of 
infoxnnational data displayed is too overwhelming, and 2) they 
were difficult to integrate and interpret by instructors. For 
example , on some devices , the last twenty actions in the 
cockpit were displayed at the lOS. At times, actions, which 
were both appropriate and totally irrelevant, rapidly scrolled 
past the Instructor and were unusable. 

h^t(?m^^^ P^rfgrmftnc^ tt^^gur^n^^nt;. if training objectives 

require performance evaluation of student procedural activity, 
then these two features should be directly correlated. 



Example 



An instructor wishes to test a student on his ability to 
accomplish a pre^flight (before takeoff) checklist. He activates 
the performance monitoring feature to observe student actions. 
During the student's performance of checklist actions, a 
diagnostic message appears on the lOS CRT which Indicates that 
the sequence of the steps the student performed are incorrect. 
The instructor might then call up the appropriate display which 
indicates exactly what the student error wai! so he can repeat the 
task. By using this feature, the instructor has obtained 
additional infoinmation to what he was abkv- to see. 



Lessons 
Learned 



Many ATDs have the procedures monitoring feature. However, 
this feature Is often not used because many of the procedures 
programmed In the simulator are quickly outdated and are not 
updated as they should be. It is mandatory, therefore, that 
data relating to aircraft procedures be easily modifiable. 

Many of the actions related to procedural activity are not 
computer detectable « For example, many of the checklists 
involve scanning cockpit gauges and checking for proper aircraft 
configuration. In those cases, any automated performance 
algorithms must not try to assign a value which may be totally 
distorted. It is important that the Procedures Monitoring 
feature be used as an aid in these cases and to provide only 
useful information to the Instructor for his overall evaluation. 



ATD Specifi- 
cation 



The procedures monitoring feature shall provide the instructor 
with a method of monitoring the sequential mission training 
activities of a student. The design ^all be easily modifiable 
and Include valid measures of monitoring procedural activity. 
The design may inc lude an automated feature of measuring 
performance of sequential procedures . The assessment of 
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student perf^ormance shall be displayed to the instructor in an 
easy- to -read and understandable format. 
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Feature 
Definition 



The freeze feature allows simulator parameters to be fixed at 
values existing when freeze is activated. Some or all device 
parameters can be fixed. The freeze feature can be operated 
either manually by the ins tructor , or it can be operated 
automatically. Automatic freeze occurs either when specified 
parameter values are exceeded, as in the case of a "crash/kill," 
or when the state of the simulator changes as in repositioning 
or going from replay to the normal operating mode. 

Common variations of the freeze feature are defined below: 

Total Sy step) Freeze . All system parameters are frozen, including 
flight control, propulsion, navigation and weapons. The entire 
simulation ceases to function from a training standpoint. For 
systems equipped with platform motion, the motion system is 
driven to a neutral position, at a safe rate. 

Partial or Parameter Freeze . This type of freeze enables the 
ins true tor to fix the value of individual parameters . The 
values of one or more parameters can be frozen at any given 
time. Common variations of the parameter freeze feature 
include the following, 

o Flight System Freeze. This feature permits the instructor 
to simult aneously freeze flight control and propulsion 
systems, position, altitude and heading. The net effect is 
that the ATD ceases to "fly\" However, all other simulated 
systems remain operational and can be used for instructional 
purposes without the burden of having to fly the ATD, This 
freeze variation functionally converts an OFT to a CPT, 

o Attitude Freeze, This feature permits the instructor to 
simultaneously freeze pitch, bank and heading, 

o Position Freeze, This feature permits the instructor to 
simultaneously freeze latitude and longitude. Thus, the ATD 
continues to "^fly" but it "goes nowhere;" 
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Purpose and Total System Pre e z e . The total system freeze is used in three 
Intended Use ways: 

o to temporarily suspend the training session so that the 
instructor can provide feedback to the student, 

o to suspend training to re-configure the simulator, or 

o automatically as in the case of crash or kill, 

PartiajL or Parameter Freeze . The partial freeze feature 
selectively freezes parts of the ATD system for the purpose of 
reducing the student's task load. 



Additional The following additional considerations should be specified: 
Consider- 
ations 

o Specify the type of freeze required. See descriptions 
under Purpose and Intended Use above. 

o In order to avoid confusion, the freeze status of the 
simulator must be made obvious to all participants in the 
simulator exercise. 



Related ISFs Slmulat^or Record/Rep].ay . The use of total system freeze is 
conimon in devices during replay. It has proved useful to stop 
the replay to allow for instruction and also when changing the 
state of the simulator from replay to the normal operating 
mode . 

Automated Simul ator Demonstration . As in simulator record/ 
replay, the total system freeze has proved useful to stop the 
demonstration to allow for student questions or instruction, 
and to allow changing the state of the simulator from automated 
demonstration to the normal operating mode. 

^il^tpt^USQ ftTQ> Total system freeze is used in most ATDs to 
stop an ongoing exercise as the first step in reinitializing 
the ATD. 



Examples Partia; Freeze . During a UPT navigation trainer period, the 

instructor suspects that the student is disoriented relative to 
his route of flight. He then activates "position freeze** so 
that he can discuss the problem with the student. Once the 
problem is resolved, the instructor "unfreezes** the ATD and the 
mission is resumed. Another example involves a student problem 
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with an emergency procedure. The instructor activates ''flight 
system freeze" so that he can point out system indicators 
related to the procedure. The student can pay attention to the 
instructor without the burden of flying the aircraft, 

Tocal. System Freeze. During an ACM trainer mission the student 
is having difficulty recognizing when he is in a missile firing 
envelope. As the student reaches the edge of the envelope, the 
instructor activates "total system freeze" so that he cr.n 
provide instruction on envelope recognition cues and relevant 
aircraft parameters. 



Lessons Total Sy^t^m Freeze . 

Learned 

o Manual, All ATDs observed in preparation of these guidelines 
had this feature. It was used in varying degrees depending on 
type of training. Freeze was used more frequently when tnsks 
being trained were relatively or totally new to the stui nt. 
Thus, at the undergraduate training level, freeze was ase'i 
extensively by the instructor while providing direct feedb . 
and corrective action. It is rarely used in total miss^. v 
training at the continuation level, 

o Automatic, All ATDs observed in preparation of this 
guidelines had an automatic freeze feature designed to be 
activated when a "crash" or "kill" occurred. However, the 
automatic freeze feature was not observed to be used. 
Instead, a crash/kill override was always set so that thi 
simulator would not activate freeze when a crash or kill 
occurred, 

P.artlal/Parameter, free^^. Evidence from several surveys 
suggests that, unless there is specific known application for 
parameter freeze in the training context, it will probably not 
be used. Partial/Parameter Freeze was found on many devices 
but was observed in use only at the undergraduate training 
leve 1 , Instructors expressed that there is little training 
value for this feature at the MAC/SAC/TAC sites, 

A design consideration is to identify the uses to which freeze 
will be put to support training needs, and then to incorporate 
into ATDs the freeze variations that meet those needs. This 
approach simplifies instructor/operator tasks while ensuring 
meaningful control over the training environment. The following 
table presents uses of freeze together with the freeze variations 
that best match each use. 



47 



INSTRUCTOR SUPPORT FEATURES 
Freeze 



Uses 

Start and stop AID to enter 
and exit, temporarily 
interrupt automated demos 
or replays, or prepare to 
reinitialize . 

Eliminate flight control and 
navigation task loading to 
better enable systems and 
procedures training . 

Enable geographic reorientation 
of the student or demonstrate 
visual scene perspectives. 

Exercise control over the 
number of axes of flight to 
be controlled simultaneously. 



Freeze Variations 
Total system freeze 



Flight system freeze 



Position freeze 



Parameter freeze 



ATD Specifi- The freeze feature shall allow the values of one or more 
cation simulator parameters (select systems /parameters^ to be frozen 

at any given time vithin a mission training scenario. The 
instructor shall have the capability to manually or automatically 
freeze the simulator or incur common variations of the freeze 
feature (total or partial system freeze) depending upon the 
intended purpose and use in supporting the training needs. 
Automatic freeze shall occur either vhen specified parameter 
values are exceeded or when the state of the simulator changes 
as in repositioning or going from replay to the normal operating 
mode . 



48 

52 



INSTRUCTOR SUPPORT FEATURES 
Simulator Record/Replay 



Feature 



Simulator Record/Replay 



Definition 



Purpose and 
Intended Use 



This feature enables the instructor to record a student 's 
action.i/inputs during a simulated mission. During a replay, 
all events which occurred as a consequence of student input to 
the simulator's controls will be reproduced. The replay will 
repeat the control movements , instrument values , displays , 
motion cues, visual scenes, sounds and voice communications which 
occurred during the period of recorded time selected for replay. 



Simulator Record/Replay allows the student to review his own 
behavior. The reduced student task load during replay provides 
a better environment for Instructor feedback. For example, the 
instructor can review the student's performance, identify 
problems and resulting errors, analyze causes of the problems 
and give guidance. 

This feature is most useful when students have difficulty 
mastering a specific skill, when new maneuvers or tasks are 
being trained and when Instructor critiques are necessary. 
Frequency of use will decrease as students become more proficient 
at performing the required tasks. 



Additional 

Consider* 

ations 



If Simulator Record/Replay is selected, then the following 
additional considerations should be specified. 

o The capability to freeze the ATD during replay Is a required 
feature for most training applications. Total systfim freeze 
Is typically used to stop the simulation prior to entering 
the replay mode and, on many occasions , to temporarily 
Interrupt replay or to terminate replay for instructional 
Interaction. 

o The means of exiting the replay is Important, In addition 
to "freeze" and allowing the simulator replay to continue to 
the end of the recorded segment, the capability of allowing 
the student to resume control of the simulator at any point 
during the replay Is also desirable. This feature Is 
referred to as the capability to "fly out" of the replay. 

o The period of time replay has typically been available has 
ranged from the last three to five minutes of simulated 
activity. In addition to computation requirements and 
memory limitations , the amount of time to allow for replay 
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should be detenuinod after careful analysis of how 
record/replay will be used and the training application 
specific to the device. 

o How to Index the starting point for a replay is very 
Important. Its selection will often dictate whether or not 
the feature will be used. Replays have been traditionally 
started by time and usually at one minute increments. 
In many cases, this has proved to be cumbersome and considered 
a waste of simulator time. If a small replay capability is 
all that is required for an ATD, e.g., two to three minutes, 
the instructor may easily orient himself by time. However, 
If the recording requirement is relatively long, as in a 
mission scenario, orientation within the replay by time only 
may not be appropriate. In this case, orientation by 
training objective or some other specific identifiable event- 
Is more appropriate. Identifiable events might Include such 
events as the beginning of an approach, surf ace- to<>air missile 
launch or engine malfunction. 

Another method of indexing Is by the instructor Inserting an 
Index flag. 

o In simulators with a motion base. It should be specified 
whether or not motion is desired in the replay. Past 
experience suggests that motion is desired only at the 
undergraduate training level. 



Related ISFs Freease (Total System) . See Additional Consider .it. Ions above. 

Automated Simulator Demo nstration. Simulator Record/Replay v 'c 
used in some ATDs by Instructors to create demonstratic : 
Automated demonstrations differ from demonstrations createu 
using simulator record/replay In several Important ways. (See 
Automated Demonstrations - Related ISFs.) 



Example During a Basic Fighter Maneuvering training exercise the 

instructor may ask the student to perform a particular maneuver. 
After completion of the maneuver, the simulator record/replay 
feature would allow the instzructor to replay the maneuver 
exactly as the student performed it with the student sitting in 
the cockpit. This would allow the student to review his own 
performance while the Instructor provides feedback to him. 
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Lessons It has been found in several surveys that student proficiency 

Learned appears to be the primary factor in deciding whether to 

incorporate simulator record/replay into an ATD, It has the 
greatest training value when the cues, responses and task are 
new to the student. This feature tends to be used most at the 
undergraduate training level. During transition and continuation 
training, it is used for training of new and also relatively 
complex advanced flying skills such as those required for 
air-to-air combat maneuvering. Simulator record/replay was not 
used during transition training or continuation training where 
rtiudents have already developed the required basic skills. In 
these cases, students were generally able to identify their 
own performance deficiencies, diagnose the causes, and take 
corrective steps without the need for such a highly detailed 
memory and diagnostic aid such as record/replay. 

It should be noted that although this feature is found on many 
of the devices, it is not a regularly and consistently used 
feature. Many instructors express tha\t this feature may have 
some value, but that they would rather use the simulator for 
"hands-on" training. This is especially crut at the MAC/TAC/SAC 
sites , 

Slow motion replay capability has been incorporated in some ATDs, 
but has not been used because it is considered "unrealistic". 



The simulator record/replay feature shall enable the instructor 
to record a student's actions/inputs during a mission training 
session. The record/replay feature shall have the capability to 
record and reproduce all events which occurred as a consequence 
of student input to the simulator's controls. Recorded student 
events shall include control movements, instruunent values, 
displays , motion cues, visual scenes , sounds and voice 
communications. The recorded time selected for replay shall be 
10 seconds; and, the recording time shall be increased to a 

maximum of minutes in 10- second intervals. A capability 

must exist to freeze the recording at any time Quiring replay 
and to exit the replay at any point during or at the end of the 
recorded segment at the instructor's discretion. Such an exit 
shall be a smooth transition to the original simulator state 
prior to replay. 



ATD Specifi- 
cation 
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Feature Automated Simulator Demonstration 



Definition The Automated Simulator Demonstration feature provides a 
prerecorded or preprogrammed aircraft maneuver, or s.;^.ries 
of maneuvers, that model desired student performance. The 
demonstration, as viewed from the cockpit statl'r reproduces all 
simulated flight conditions that occurred when tlt^e mane ver was 
originally recorded or programmed. This includes the actuation 
of cockpit instruments, indicators, flight controls, motion 
system movemenc, visual display scenes, and crew communications. 



Purpo?<e and 
Intended Use 



Additional 
Consider- 
ations 



The purpose of this feature is to provide a model that the 
student can observe, analyze, pattern his own behavior after, 
and use as a reference for self-evaluation in subsequent 
training or during operational flying. Demonstrations identify 
the signiflcanc cues and discriminations the student must learn 
and provide instructional commentary that may facilitate task 
mastery. Demonstrations are normally used by the instructor to 
introduce a new maneuver to the student. Demonstrations are of 
greatest value when the student Is unfamiliar with the task to 
be learned. 



If Automated Simulator Demonstration is selected, then the 
following additional considerations should be specified. 

o It is Important to be able to modify the stored demonstration 
as alrcrafc snd aircraft operating procedures change. 
Modifications should not require timely, expensive software 
re - development . 

o The capabilitlss to freeze or stop a demonstration, to 
re. initiate it from the beginning, and to enter the 
demonstration ac a desired point should also be specified. 

o If the ATD has a motion base, then a safety warning for 
"Hands and feet clear" should be clearly issued whenever the 
demonstration is to be played. 
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Related ISFs g tn^ulator Racord/^leplay > Simulator record/replay is used 
primarily to record the last few minutes of a student's 
performance for replay and review by the student and instructor. 
Occasionally, the instructor will take the controls, fly the 
simulator from the cockpit or the IDS, and immediately replay 
his performance to demonstrate something to the student. 
This type of demonstration is different from an automated 
demonstration in several ways. Because only the last few 
minutes of simulator time are stored, this feature does not 
provide a pexrmanently stored and available demonstration. Each 
time an instructor wishes to demonstrate something to the 
student, he must re -record it. Such demonstrations v^.ry from 
instructor to instrrictor and from one recording to the next. 
Thus they each provide a slightly different model of behavior 
to the student, rather than a standard. Additionally, such 
demonstrations, recorded in the midst of an on- going training 
session, provide an approximation of the desired behavior 
rather than an optimal model. 

p y^eze . See Additional Considerations, above. 



Example An automated demonstration can be constructed for any segment of 

flight. For example, an ATD can be programmed to takeoff, fly 
straight and level, refuel inflight, perform aerobatic or air 
Combat maneuvers, deliver weapons, fly a standard approach, or 
land without the student or instructor operating any primary 
controls. 



Lessons Although automated demonstrations would appear to have great 

Learned practical application, experience has shown that this is not 

true in certain cases. In two recent surveys of ATD use, 
automated demonstrations were found on many of the devices 
surveyed but their usage was minimal and inconsistent. One 
reason may be found in sentiments expressed by training 
personnel at the simulator sites. Many instructors felt that 
this feature might have some value. However, simulator time 
reserved for ''hands on" training was too valuable to give up 
for such demonstrations. 

Automated demons tr^^t ions are of greatest value when the student 
is unfamiliar with the basic task or characteristics of the 
aircraft he is learning ^ to operate . Suirvey results indicate 
that demos are used mostly for undergraduate training. However, 
even this use was sporadic and not by all instructors. 
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titlfn automated simulator demonstration feature shall provide a 

cation prerecorded or preprogrammed aircraft maneuver, or series 

of maneuvers . that model desired student perfor^iance The 
demonstration shall reproduce all simulated flight conditions 
including activation of cockpit instruments, indifatorr fUght 
controls, motion system movement, visual display scenes and 
crew communications, as viewed from the cockpit station 

diTrTml^M'""' I'"'' ^"^^^'^^ sigs^iacant cues ^^d 

ttlll t^^^^^""^ '^^^ ''^"^^"'^ ""^^^ and shall provide the 

Jr^f^ l^'ll^ commentary that may facilitate task mastery Se 
design shall provide ease of software modification and shall 
V. L.Tnn? "P^bility to freeze, stop, re-inltiate at the 

^ beginning, or to enter the demonstration at a desired point 
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Feature Automated Performance Measurement 



Definition This feature provides quantitative measures of student 
performance in the aTD. It is intended to be used as an sdd by 
the instructor In his overall evaluation of the student. 



Purpose and 
Intended Use 



Additional 
Consider- 
ations 



Automated Performance Measurement supports the instructor 
during training by providing the following: precision, 
objectivity, standardization, and the capability to measure many 
facets of performance simultaneously. It can provide sensitive, 
reliable and valid measurements of student performance during 
times when the instructor may be preoccupied with other 
Instructional tasks. Except for obvious objective measures' 
(e.g., bomb score), the final evaluation rests with the 
Instructor, This feature may also be used by the student 
during self .practice as a measure of his progress. 



Measurement by User-Deftned Oblectlves, Most automated 
performance measurement capabilities on existing trainers, 
aside from being quite simplistic, require manual control by 
the instructor. There are no "intelligent" start/stop 
logics which "know" what the crew is doing and thereby 
know what parameters to measure. Practically all automated 
measurement capabilities in existing ATDs are best described 
as performance monitoring and data collection systems. 
These capabilities allow instructors to select tolerance 
bands (e.g., +/- 100 feet) around various performance 
parameters (e,g., altitude). The performance monitoring 
capability then monitors for cases that exceed the toler^mce 
bands values, and records out- of - tolerance conditions fo-;r 
subsequent display at the instructor's console or for hardcopy 
printouts. Such rudimentary performance monitoring 
capabilities have been used to effectively drive automated 
performance alerting systems and automated cueing and coaching 
systems. However, they have found little acceptance as an 
aid for performance evaluation and learning diagnosis durine- 
training. ^ 
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Performance measurement systems for aircrew training must be 
designed to support specific training objectives. They should 
be designed around user needs and requirements. Thus, the 
specific design of an APM will depend on its training 
application. In this context, the user can define performance 
criteria. When various measures are properly weighted and 
combined, the resulting measure set collectively can be 
quite useful to the instructor. The specification for an 
APM should include the requirement for a formal development 
and validation program where inputs by the end user are 
tried and refined using the fully developed system. The 
system must also be designed such that "fine tuning" 
performance algorithms may be accomplished on-site, 

o Timely Feedback s An APM system designed for use in training 
must perform all statistical and other processing of 
performance data in real or near-real time so that students 
and instructors are provided with useful, concise and timely 
performance feedback information. 

Measures may be displayed on-line for use during the training 
session. This type of information must be computed in a 
timely manner such that the results may be used by the 
instructor for immediate feedback. 

The measures are also output as a stmmary to be used for 
debriefing purposes. On some of the devices, the output 
is also used for student recordkeeping. If this is a 
requirement, there must be a mechanism whereby the instructor 
can override or modify the measure as his overall evaluation. 



Related ISFs: Remote Graphics Replay , A complete summary of the performance 
measurement output including what was measured, how it was 
measured, and an instructor input (override and/or modification) 
is required as part of the debriefing. The student and 
instructor will know precisely the means by which the results 
were attained. In this way the "black box" stigma of computer 
grading can best be eliminated, 

Da^ra Storage and Analysis , The data storage and analysis 
feature will derive much of its data from automated performance 
measurement . 

Procedures Moni torlner . If training objectives require 
performance evaluation of student procedural activity, then 
these two features should be directly correlated. 
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Example An example of the use of Automaf... ^ormance Measurement by 

objective would be the evaluation of a basic air- to -surface 
weapons delivery (pop-up) using the example measurements listed 
be lov . 

o Attack run-in performance at closest point of approach 
to a pre-planned position along the run-in corridor, measure 

altitude to be within tolerance band 
airspeed to be within tolerance band 
ground track to be within tolerance band 

o Pop-up performance, measure 

distance from the target to be within tolerance band 
when vertical velocity exceeds defined parameters 
highest altitude obtained to be within tolerance band 
(low enough to minimize exposure, high enough for safe 
and accurate delivery) 

position at which highest altitude achieved to be 
within appropriate distance from target 

o Weapons delivery performance, measure 

dive angle to be within tolerance band 

release altitude to be within tolerance band (low 

enough for delivery accuracy, high enough for safe 

recovery) 

airspeed at release point to be within tolerance band 
yaw at release point to be within tolerance band 
ordnance impact to be within lethal range of target 

o Exit performance at minimum altitude on pull-out, measure 

altitude to be within tolerance band to avoid 
fragmentation pattern 

ground track to be within tolerance band (with respect 
to pre-planned exit route) 

altitude to be within tolerance band (with respect to 
pre-planned exit route) 

This information should be used in addittop to the instructor's 
judgement about the student's performance, no£in liUceof 
i£. Measures would be available to the instructor for each of 
the steps listed for this objective. As the student concluded 
each step, the instructor would be able to determine iEraedlate^y 
if the step had been completed within the prEd«temlned 
tolerances. If an overall score was desired, cKe ^j^^ou- 
measures for each step could be weighted end combi^^ca trv yta'it* 
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INSTRUCTOR SUPPORT FEATURES 
Automated Performance Measurement 



an overall score for performance on this objective. As in the 
case of the individual step measures, this score would be used 
in addition to the instructor's assessment of the student's 
perforaance. This objective summary and the individual measure- 
ments vould then be made available for instructor review for 
his final evaluation. 

The performance measurement information, vhen used with remote 
graphics replay, becomes a powerful debriefing and evaluation 
tool. While graphically viewing the route flovm during the 
exercise and the visual HUD cues during the run and at release, 
the measures provide the basis for instructor feedback and 
discussion with the student. The instructor may then formulate 
his final evaluation. 



Lessons Automated Performance Measurement is an instructional feature 

Learned which has probably taken on the greatest variety of 

configurations. There are misconceptions as to what it can do 
and what it cannot do, and therefore it is a feature which is 
least accepted and used. If this feature becomes a requirement 
on a specific device, then there must be an educational process 
and complete understanding as to its purpose and intended use. 

Some ATDs have a feature called performance measurement where 
bomb drops and missile shots are scored, However, this feature 
is not used because instructors feel that the basic simulation 
does not provide the cues necessary to properly launch the 
weapon. In order for automated performance measurement to have 
meaning, the APM has to take into account the fidelity and 
completeness of the simulation. For example, a visual system 
with only 48 degrees field of view may not be adequate to 
provide the visual cues for a conventional bombing pattern. 



/^•JD the automated performance measurement shall aid the instructor 

Specification in obtaining a valid and reliable measurement of srud(VAt 
performance. The feature shall be designed to support specific 
training applications and to provide the instrucccr with a 
precise, objective standardized measure of student performance 
and a capability to simultaneously measure many facets of a 
mission event. The instructor shall be provided timely feedback 
of performance data in real or near-real time; and it shall be 
displayed on-line for use during a training session or off-line 
for debriefing purposes. 



60 

62 



INSTRUCTOR SUPPORT FEATURES 
Hardcopy/Printout: 



Feature 



Hardcopy/Printout 



Definition 



Hardcopy/Printout provides for the retrieval of data from any 
specified source within the simulation - i.e., parameters, 
variables, real-time display content. It retrieves and creates 
a hardcopy print of the data upon demand and in such a way that 
no interruptions occur within the simulation and its displays. 



Purpose and 
Intended Use 



Hardcopy/Printout provides the instructor with a printed copy 
of selected information obtained during the training exercise. 
It can provide the instructor with information about the training 
exercise and the student's performance. Both graphic flight 
profile data and performance summaries can be provided. The 
copied data is especially useful during debrief for reviewing 
the exercise as a whole, for comparing the student's performance 
over the course of the exercise, and for looking for improvements 
in performance over several simulator exercises. 

Hardcopy/Printout supports permanent recordkeeping. Used in this 
way, it provides a means of comparing and reviewing all students' 
performance in the training program. Training managers can more 
easily determine whether or not students are meeting training 
objectives on schedule. In addition, through the ISD process, 
a comparison of this sort facilitates on-going evaluation of the 
training program itself. 



Additional 
Consider- 
ations 



Several problems have occurred in current implementations 
which have resulted in less use of this feature than would be 
anticipated. The printed information should be provided in a 
convenient format and under time and location constraints such 
that it is useful in the conduct of training, debriefing and 
recordkeeping. If this feature is selected, the following 
considerations should be specified, 

o If a printout of a graphics display is requested, neither 
real-time data being displayed nor the simulation should be 
interrupted or delayed. 

o The printer should be readily accessible to the instructor 
as he conducts the mission. In addition,- the noise caused 
by the printout of information should not interfere with 
training activities. 
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Example 



Lessons 
Learned 



o The printed information should be well formatted and organized 
around the instructor's needs. Organization according to 
training objectives is desirable. 

o It would be highly desirable to allow some flexibility in 
the content and format of the printed information. For 
example, some applications or instructors might require more 
detailed information than others. Perhaps an option similar 
to a "declatter" option for displayed output would be 
desirable in such a situation. In addition, as flight 
procedures and subsequent training objectives change, it 
would be convenient to allow some modification of the 
information to be printed out. 



: i \t4tomated Performance , Measurement . If an ATD has the automated 
performance measurement feature, hardcopy performance summaries 
can be produced. 



During a training session the instructor flags various graphic 
plots and sets of performance measurement data for use in 
conducting the debrief. During the debrief he uses the printouts 
of the plots and data to guide his feedback to the student when 
dynamic replay and feedback are not required. The printouts 
are also helpful in guiding use of the remote graphics replay 
feature. 



This feature is found on most ATDs , While a potentially useful 
feature, printout is seldom used at most sites. Problems in 
reliability and ease of implementation were noted. For some of 
the simulators observed, use of the printout feature requires 
that the system be taken down from the runtime programs prior 
to providing the hardcopy output. This was observed to be 
restrictive to actual training because by the time the copy is 
made , the instructor has already debriefed the student. In 
other cases, use of hardcopy required that the display being 
copied be frozen while output was produced. This was disruptive 
with respect to real-time feedback. 

In some cases the reason instructors didn't use the printout 
feature was because they didn't know it existed or how to use 
it. 

The ability to obtain a printout of graphic flight profile 
information for subsequent debriefing was viewed favorably and 
used by instructors. Graphic situational displays are generally 
more preferable than numeric summaries . Some ATDs produce 
performance alert symbols overlaying flight profile data , 
This too was viewed favorably as a debriefing aid. 
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Reports that do Uctle more than list parameter data at a 
specified sampling rate are rarely used. For ATDs which include 
an automated performance measurement system. Information should 
be sununarized into a format meaningful to the instructor/console 
operator. 



cltifn Hardcopy/Printout feature shall retrieve data from any 

cation specified source within the simulation - i.e.. parameters^ 

variables, CRT display content. It shall retrieve and create a 
hardcopy print of the data upon demand and in such a way that 
no interruptions occur within the simulation and its displays 
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Feature 



Remote Graphics Replay 



Definition 



Purpose and 
Intended Use 



Additional 
Consider- 
ations 



This feature provides a post -mission graphic and dynamic 
re-creation of a training exercise which has been 
previously recorded. This replay is conducted at a remote 
computer graphics console and may be accessed concurrently 
while training is being conducted on the ATD, 



Debrief at the conclusion of a simulator session provides 
the student the greatest part of his performance feedback. 
Typically during the debrief, the instructor reviews student 
performance, reinforces instructional points, answers questions 
and points the student co the next instructional activity. 
This information is normally provided by instructor recall and 
his ability to take notes during the exercise. This type of 
debriefing varies accordingly- With the aid of a graphics 
replay, the instructor's ability to debrief is greatly enhanced. 
This feature will also relieve the instructor of note -taking 
during the actual conduct • r an exercise. This type of 
debriefing feature also allov- - instructor and the student 
to determine when and why the dr. at ion occurred. 



Replay Indexing. It is important that a convenient method 
of indexing into a replay be designed into this feature. 
Positioning within a prerecorded exercise must be oriented 
toward the end-user. Indexing methods specifically tailored 
to training would include indexing by training objectives 
and/or instructor- inserted flags. For example, the instructor 
should be able to easily select an approach which had been 
previously executed. Upon selection, the graphics would 
replay from the starting point of the objective. In this 
case, the starting point would be at the initial approach 
fix. Instructor- inserted flags are also used to facilitate 
locating points of interest in the mission, 

t^ep^ay ContyoT,. The control of the graphics replay should 
include the selection ^f optional graphics as provided during 
the exercise. In addition, the exercise should be able to be 
replayed at either normal or fast speeds and frozen at any 
point for review and feedback. 
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Related ISFs: ^utopiated Performance Measurement . The remote graphics replay 
is used in conjunction with automated performance measurement 
review. These two features should be interconnected such that, 
in addition to replaying a ^raining objective, any performance 
measurement associated with that objective can also be reviewed 
accordingly. 



Example After leaving the trainer, the instructor and student proceed 

to a remote station for post-mission debriefing of a navigation 
training event. The Instructor calls up selected portions of 
the navigation route for replay in a dynamic graphics format . 
lie also calls up the performance measures which were taken 
during the recording of the training objective. The student 
and Instructor obsein^e the replay, and the Instructor critiques 
the student and provides performance feedback. 



Lessons Instructors in general believe that time on a simulator is best 

Learned spent doing "hands on" training. It is therefore most important 

that a replay feature include a remote console which can run 

concurrently with normal training. 

Although not enough data has been collected to provide lessons 
learned vl respect to this type of feature which includes a 
remote cci ; \&, the operational feedback thus far has been 
positive . 



ATD Specifi- The remote graphics replay feature shall provide the capability 
cation to recreate a graphic and djmamic replay of a training exercise 

either conducted at a remote briefing/debriefing console or 
conducted concurrently on the ATD. Automatic indexing by 
training objectives , in addition to instructor- Inserted flags 
shall facilitate locating points of Interest in the mission. 
The feature shall also provide normal or fast speeds for replay 
and a capability to freeze any point within the training 
exercise for review and feedback. 
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Feature 



Data Storage and Analysis 



Definition 



This feature records information pertinent to student and crew 
performance during the training session as well as to certain 
aspects regarding the operation of ;he system. The data is 
grouped by student, student type, student class, etc., and 
Includes the objectives attained, tine/attempts to attain the 
objectives, and conditions under which the objectives were met 
or not met. 



Purpose and 
Intended Use 



This data serves up to three purposes depending on whether the 
device has the related features described below: 

o This information is used to "fina tune" the performance 
measurement algorithms . 

o The data storage and analysis feature will combine all of 
the data and categorize this informacion with respect to to 
student type, experience level, etc. This summary will be 
primarily for curriculum managers. The infornacion provides 
dynamic feedback which can be used in gaining maximum training 
effectiveness from the ATD. 

o This information will be retained on the system as part 
of a student's record as long as desired. This information 
is available for instructor and student review via the 
Briefing Utility. 



Additional 
Consider- 
ations 



If the Data Storage and Analysis feature is selected, the 
following additional consideraticns should be specified. 

o The data summarized for analysis will have to be accessed 
via an output device that does not interfere with normal 
simulator operation. This is normally accomplished off-line 
via a computer system console and printer for hardcopy 
outputs . 

O The inforasatlon for the Purpose and Intended Use cited above 
should ba isidividually tailored to the end user. For example, 
a student's personal record should contain data specific to 
that student and should not contain the type of voluminous 
data summaries that are contained in the summary of simulator 
utili2a«:ion/ef f ectiveness . 
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Data _Storage and Analysis, 

o A utility in the form of a data editor is required to enter 
administrative data and interact with this feature off-line. 
Examples of this are entering new st:udex:ts, deleting old 
students and their records when they are no longer needed, 
and deleting other stored data when it is no longer required. 



Related ISFs Briefing Utility . The Briefing Utility is desirable Co access 
the student performance data from this feature. If a debriefing 
utility/remote console is not available, this information may 
be accessed via a computt:?r system console with hardcopy output. 
The hardcopy output may then be used by the instructor during 
briefing. 

i\utom^ted performance Measurement: . The data storage and 
analysis feature would provide dynamic feedback to "fine tune" 
performance algorithms. 



Example Prior to a brief ing, - the instructor reviews student performance 

records to detemine his training progress and to diagnose any 
aspectf^ of perfoirmance which may affect this trainer event. 
For instance, prior to a scheduled event for advanced instrument 
approach training, he notes that the student has had problems 
with altitude and heading control. As a result, he decides to 
give the student some basic approach scenarios before proceeding 
to the more complex scenarios scheduled for the event. This 
tailoring" of the event provides some remedial warm-up for the 
student and allov;s the instructor to confirm the student's 
readiness for advanced scenarios. 



Lessons This is a fairly new feature which has been implemented on a 

Learned only a few ATDs. On one new system, a date. ;orage and analysis 

feature with a structured student trackiisf.r comparative system 
is provided. Since thi/s system was just recently installed, no 
data has been collets ted v;ith respect to operational usage . 
However, user rs^sponse waa very positive during its introduction. 



ATD Specifi- The data storage and analysis feature shall record pertinent 
cation student and crew performance information during the training 

Si&ssion and may also store information regarding certain 
aspects of system operation. The data may include information 
grouped by student, student type and class, the objectives 
attained, time/attempts to attain the objectives, and conditions 
under which the objectives were met or not met. Such information 
shall be retained on the system, for as long as required by the 




68 



69 



INSTRUCTOR SUPPORT FEATURE 
Data Storage and Analysts 



training program, as part of a student's record and accessed 
via an off 'line output device as well as provide an overall 
dynamic feedback evaluation for curriculum managers. The 
design shall be indi^^ldually tailored to the end user and shall 
provide an interactive data entry capability for administrative 
information update. 
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SECTION III 

SELECTING INSTRUCTOR ^V^^VC *. ?E:ATURES 



Purpose This section presents a systematic approach for the selection 

of instructor support features. Section II provides definitions 
of ISFs, their intended use , and lessons learned from surve.ys 
of current ATDs. ISFs are intended to support the instructor and 
improve the overall training effectiveness. To this end, ISFs 
mu^t be identified which support instructor functions and are 
oriented to the specified training to be performed on the ATD. 

In the past, ISFs hr>ve been specified without a thorough 
analysis of their need or how and when they should be used. 
They were included because it was felt they might be helpful, 
or because they were included on other similar ATDs . This 
approach does not allow for effective selection or design of 
the features, and generally results in a system that is 
cumbersome for the inscructor to use. It also can lead to a 
device which includes many features which are seldom, if ever, 
used. 

This section discusses the approach used to detemnine ISF 
requirements for the sample specification in Appendix C. It 
specifies the rationale for each ISF selection, and identifies 
how it: is to be used. This is not the only vniy to approach 
this issue; rather^ it provides a guide to be used in other 
specification efforts . More importantly , this procedure 
clarifies to the ISS designer how each feature should be used 
and hopefully produces a system to match user needs. 



Overview Simulator specifications have been developed under highly 

structured methodologies such as Instructional Systems 
Development (ISD). These methods primarily address the student 
interface with the training device. They relate device training 
characteristics to specific operational tasks , but do not 
consider training effectiveness requirements of the instructor. 
Specifying the instructional system for any ATD requires a 
firm understanding of ISFs, training requirements, and the role 
of the instructosr in the training cycle. 

To define the instructional system, an approach should be 
used which integrates the training requirements with the 
instructor's functional requirements to identify ISFs which 
would aid the instructor and enhance overall training 
effectiveness. This approach is similar in many respects to the 
task and mission analysis used to define aircrew training 
requirements . * The following areas , to be addressed in this 
section, should be considered: 



73 

73 

EKLC 



SECTION III 

SELECTING INSTRUCTOR SUPPORT FEATURES 



o 



Front'End Training Analysis 



o 



Instructor Functions 



o 



Pre -training Requirements 



o 



Training Requirements 



o 



Post- training Requirements 



o 



Benefit Analysis 



Front -End 

Training 

Analysis 



o Technology and Cost Considerations 

Instructor support features are designed to facilitate the 
instructional process. They are Intended to improve the 
"efficiency" of the training. Only those features which 
support the instructional objectives or instructor task should 
be included in the specification. 



Before any ATD is specified, a front-end training analysis must 
be accomplished to determine ATD capabilities to support 
training. This analysis provides valuable information which is 
necessary in determining ISF requirements to support the 
training program. The following Information from the front -end 
analysis will be used as inputs to the training requirements 
phase: 

o gtudent skU^ afi d , knowledge level, - This identifies the 
ATD user groups: -^lii-.d provides Information on how training 
will be conducced and the use of various training 
methodologies. The general training objectives of the 
various user groups may be similar, but the content and 
conduct of the training events may be different, 

o Trainlt^ g _ task objectives - This specifies what is to 
be trained under what condicions and to what standards. 
This Information is used to specify the instructor's 
control and information requirements in order to conduct 
the specified training. 
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o Training: syllabus - This information specifies how the 
training objectives will be tied togta^cher to form training 
events. It must be analyzed to determine what instructor 
controls and information will be required to perform each 
training event efficiently. 

As can be seen, a thorough analysis of the training needs of 
the aircrew plays an important role in the ISF analysis. 
Without the front-end training analysis, it is difficult to 
determine the exact needs of the instructor and define design 
requirements to meet training efficiency. 



Instructor The total training situation includes not <w.:dy the training 
Functions device and the trainee but also the training syllabus and most 

Analysis importantly, the instructor. He Is the key to ATD training. 

The instructional effecs^iveness of the simulator is dependent, 
to a large dagree, on the manner in which the instructional 
system is designed and implemented. Maximizing the instructor's 
ability to fully utilize the capabilities of the ATD is crucial 
to improving the effectiveness of the ATD, 

Since most training features are designed for use by the 
instructor, it is necessary to have a good understanding of his 
role and job function. Instructor functions are implicitly 
known, but by explicitly defining the instructor functions 
according to specific training needs, one can identify design 
requirements which will enhance the total training system. 
Instructor functions should be analyzed in three distinct 
areas. These are: 

o Pre -Training Requirement^ - instructor activities which 
are required prior to the actual training session on the 
ATD. This would include functions such as training 
session preparation and briefing, 

o Trjitnttig Reouirement s - this includes instructor activities 
required during the active training session on the ATD, 
It would include instructor functions such as controlling, 
instructing, monitoring and evaluating traifting activities, 

o PQgt-T;ralptt>g |;l?q ^lr^m?nLts - instructor activities required 
after the actual training session on the ATD, It includes 
such functions as debriefing and record keeping. 

Each of these areas ig • discussed in detail in the following 
sections . 
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Pre-Tr^i^^.'^g Prior to conducting training on an MD, an instructor has many 
Requiremei^ts requirements which must be accomplished to enhance the training 
session. These include: 

o Instructor Training Fun c t i o n - The instructor must be 
capable of utilizing the instructional subsystem to provide 
effective training. This means that the instructor must be 
trained on console capabilities, operation, and the 
use of the capabilities to provide effective training. In 
addition, ins tiruc tors will require refresher training at 
periodic intervals to maintain their proficiency. This 
requlx'ement can be met through many ways; formal training, 
computer -assisted ins cruet ion, instructor handbooks , or 
the instructor support feature which is capable of providing 
self-paced instruction at the instructor console and/or a 
remote console: 

o T orial 

o P_repare function - The instructor must be familiar with 
all aspects of the planned training event prior to 
briefing the trainee. This includes a review of the event 
description, specific training objectives, performance 
criteria, procedures to be followed, and current stacus of 
the ATD. The instructor should review the trainee's 
perfonnance records to determine his training progress and 
to diagnose any aspects of performance which may affect 
the current training event. Tliis process is necessary so 
the instructor can plan how the training event will be 
conducted, identify control requirements, training methods, 
and possible event tailoring to meet the needs of the 
trainee. 

All required information should be available at a single 
location via hardcopy or a remote console/terminal. 

o Tyj^lrnl,T^g Set-up Function - This activity is normally 
performed at the ins tructor ' s console prior to the start 
of the training event. However, a capability could exist 
which allows the instructor to tailor the training event 
off-line (remote console) and recall the information at 
the instructor console for initialization of the ATD. A 
training system which utilizes the task module concept 
(see Section IV) could allow the instructor to tailor the 
training event by objectives, specify variables such as 
control of the environment and targets prior to the active 
training ses sion . This capability would reduce the 
instructor's workload at the console and provide efficient 
use of the ATD training time. 
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Another consideration Is Ins tructorless training. If 
Ins t rue tor less training is required, the instructional 
system must be designed to accommodate this need. It 
should allow the student to select and activate training 
scenarios to meet the required training needs . The 
objective based Scenario Control ISF could provide such a 
mechanism. 

o Develop Training FunctloT) - This involves the identification 
of changes to the training syllabus, implementation and 
validation of these changes. This function requires design 
considerations which allow it to be performed easily in a 
timely fashion. This function should be capable of being 
performed from a remote location which will not interfere 
with the active training capability, A training system 
which utilizes a task objective data base provides a 
mechanism by which the instructor can easily modify and/or 
develop new training scenarios based on the existing 
training objectives, 

o Brief fuT\ctj.9^ - This Involves reviewing with the student 
the training event, specific training objectives and 
performance criteria and known ATD discrepancies. Depending 
on the level of training, the instructor may be required to 
discuss common difficulties, specific procedures, 
techniques, displays and cues which would enhance the 
hands-on training in the ATD . As noted previously, 
training event information can be stored and retrieved 
from the ATD computer storage. Likewise, informational 
displays and graphics, which are useful to the briefing 
function can be retrieved for the instructor's use at a 
remote console. The instructor support feature which 
relates to the brief function is: 

o Briefing Utilities 

The pre -training requirements deserve careful consideration in 
determining instructor support feature requirements. A training 
system which is designed around Instructor needs and provides 
information in a meaningful easy- to- interpret format can 
benefit the instructor during his pre- training requirements. 
In particular, the preparation and briefing functions can 
dramatically affect the training process. 



Training The support requirements of the Instructor for conducting 

Requirements simulator training vary from ATD to ATD. In one Instance the 
instructor is onboard the simulator with the trainee; in 
another the instructor is located offboard at a remote console. 
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Even though there are configuration differences among ATDs, 
the role of the instructor remains the same. The instructor 
must control the training, monitor trainee activities, provide 
instruction and evaluate performance. These are thz functional 
requirements of the instructor which must be performed to 
accomplish the active training task. The instructor's support 
needs will depend on his location relative to the trainee and 
the training requirements. These support needs will be expressed 
in terms of control and informational requirements of the 
instructor to provide effective training. These factors play a 
key rolo in the design requirements of the instructor's station 
and must be identified up firont during ATD specification. 

To determine Inscructor support needs, a thorough analysis 
of the activities performed by the instructor during training 
is necessary to ensure an optimum design. The front-end 
training analysis should be used to identify what has to be 
controlled and displayed to the instructor so he may perform 
the functions of controlling, monitoring, instructing and 
evaluating performance. 

The following sections discuss considerations for each of the 
instructor functional requirements. 

o Control Funppion - includes all activities pertaining 
to the control of the training exercise. It includes 
control of the content and conduct of the simulation 
exercise as well as basic simulation. An analysis of 
the training task and syllabus events will identify control 
requirements. It was obseirved on data collection trips 
for this document chat inscructors spent much of their 
time inputting and controlling simulation variables. This 
detracted from the primary responsibility of instructing. 
It should also be noted that in all cases instructor 
support features existed in these ATDs which would have 
eased the instructor's workload, but they were not designed 
effectively to meet his needs; thus the features were not 
used. Five instructor support features are defined in 
this manual which directly relate to the control function. 
They are; 

o Scenario Control 

o Initial Conditions 

o Real-Time Simulation Variables Control 

o Malfunction Control 

o Reposition 

The definition and supporting information for each of these 
features should be read thoroughly then compared with the 
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control requirements identified for the task and syllabi 
to be trained to determine their applicability. 

o Monitor Functlop - involves the presentation of information 
vhich is required by the instructor to perform the training 
functions. This information must be available when the 
instructor needa it and presented in a format which is 
easy to interpret. Two instructor support features 
which address the monitoring function are: 

o ICS Display Control and Formatting 
o Procedures Monitoring 

Information formatting is required of all ATDs. Currently 
CRT flexible format displays are the preferred mechanism 
for providing the instructor with cockpit and situational 
information . By defining the specific training 
requirements, display of relevant training activities can 
be speci/:led to provide the instructor the necessary 
information. Without defining the instructor's specific 
needs, it is possible that the instructor could have the 
wrong information displayed at a critical point, or 
displayed in a format which is difficult to interrupt. 
For manual selection of displays, options should be kept 
to a reasonable number and grouped by training objective^ 
otherwise the instructor will simply be unable to utilize 
the ch o ice s e f f e c t i ve ly . 

o Instruct Functioyi - Involves those activities that direct 
the growth of skills and knowledge of the student while 
providing knowledge, Information, and feedback in a 
systematic way. The training analysis identifies the 
training task and the skill and knowledge level of the 
students . This information must be considered when 
defining features to support the instructional capability 
of the ATD. Three instructor support features aro? defined 
which support the Instruct function. They are: 

o Freeze 

o Simulator Record/Replay 

o Automated Simulator Demonstration 

It should be noted that these features are for on-line 
instruction. Off-line instruction, e.g., debrief, is 
considered under the Post -Training Requirements. 

o Evaluate Function - Involves monitoring relevant training 
parameters which reflect the performance of the trainee 
during the training session and assessing whether the 
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observed performance meets specified training criteria. The 
evaluation function is closely tied to the monitor function 
in that the instructor requires the relevant training 
information presented at che appropriate time in a 
meaningful easy- to- interpret format. The lOS Display 
Control and Formatting ISF can aid the instructor by 
minimizing his workload, allowing more time for his 
primary tasks of instructing and evaluating. 

Another method of evaluation is to let the ATD automatically 
provide performance evaluation data in terms of Che 
standards defined in the training task analysis. Such a 
systera can provide sensitive, reliable and valid 
measurements of the trainee's performance. The feature 
which supports che evaluate function is : 

o Automated Performance Measurement 

An Automated Performance Measurement feature should 
include a capability which allows the ins tructor to 
override or modify each performance evaluation. Not all 
training can be evaluated through APM. But on those tasks 
where APM can be applied, it reduces the instructor's 
workload and provides a greater degree of evaluation 
s tandardlzat ion . 



Post -Training At the completion of active training on an ATD, the instructor 
Requirements must perform certain functions Co complete the training cycle. 
Two functions which must be performed are debrl-^fing che 
stucent and recording pertinent daca from che training session, 

o Debrief Function - involves the review of the training 
session with emphasis on student performance evaluation 
and inscruccion. Debriefing is the most widely used 
form of feedback in military training. The debriefing 
function is an extremely valuable instruction method. 
The instruccor can analyze student performance, identify 
problem areas and recommend corrective action for subsequent 
training. The instructor must have the relevant training 
inf ormat ion available during debrief Co perform thi \i 
function effectively. In many cases the only information 
available to the instructor for debrief are hand-writcen 
noces and specific items that the instructor can remember. 
This method can be cumbersome , detract from the active 
training session, and possibly cause the instructor to 
miss, or omic key craining points. Two instructor support 
features which can aid the debriefing function are: 
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o Hardcopy/Printout 

o Remote Graphics Replay 

Hardcopy can provide data and graphic printouts which 
are pertinent to student performance during the training 
event. For all printouts, information concerning content 
and format will be required during ATD development. 
Hardcopies provide "snapshots" of the training event at 
the time of selection. Where dynamic recreation of 
specific events is required, a remote graphics replay 
feature could provide this information. This replay would 
be conducted at a remote console so as not to interfere 
with active training on the ATD. 

o Record Function - includes activities associated with 
obtaining and recording pertinent data associated with the 
training session in terms of student performance and 
device operation. The data storage and analysis feature 
can aid the instructor in the performance of this function. 
It can also provide student progress information necessary 
for the Pre-Training Requirement, and data pertinent to 
the management of the training system. 



The Instructor Functions Analysis, presented above, identifies 
where instructor support features can be used to aid the 
instructional efficiency of the ATD. Some of these features 
are required to perform the necessary training function-;, 
e.g., lOS Display Control and Formatting, while other features 
would be considered "nice to have/' At some point in the 
specification process, due to cost and other factors, the ISFs 
to be included must be prioritized. This requires that a 
benefit analysis be performed to identify which features should 
be included in the specification. The results of this analysis 
will produce a prioritization of features based on their 
overall contribution to training efficiency. 

It should be noted that this prioritization does not take cost 
into consideration. Although cost will ultimately be a deciding 
factor with respect to the final ISS configuration, these 
guidelines are intended to emphasize selection based purely on 
functional requirements. In other words, the set of instructor 
support features selected and prioritized should be considered 
the " ideal set" : those features which would be included if 
cost was not a factor. Subsequent "trimming" of the features, 
based on budgetary considerations, should be made from this 
baseline. 



Benefit 
Analysis 
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The benefit analysis shoLc include the following training 
considerations . 

o Fyeqyien^v o^ X^e^^^fj^ed Neod . The projected frequency of 
use should be considered in the prioritization of the 
selected instructor support features. Fe-atures which 
would be needed more often, in general, will have higher 
priority among those selected. However, if a feature is 
the only effective method of training a specific critical 
task or if it is by far the most efficient method, ♦zhen 
it should be considered a higher priority feature, 

o It ]? true tor Load^.pg . The impact on the ins true tor 's 
workload is another important consideration in prioritizing 
features. Features which substantially reduce the 
instructor's workload should be giver, a higher priority, 

o V3eabf.^.tty of th^ System . This is related to instructor 
loading. It is important to consider what tasks the 
instzructor will be required to do if the feature is not 
present. For example, if features supporting the control 
function are not included, the instructor would be required 
to spend more time and attention controlling the simulator 
and less time instructing the student. 

o T^^^-Pf-^ g g^^lc j.eiicy ■ Some features directly affect the 
training efficiency of the ATD, For example, a remote 
briefing utility console or a remote graphics replay 
console would allow pre- training or post- training functions 
to be carried during the "hands-on" training, This type of 
configuration maximizes the total amount of training 
carried cut on the ATD. 

o I^F Ipt^rdepep^ency Requirements . As pointed out in the 

section describing ISFs, the selection and design of one 

feature may impact the selection and design of other, 

related features. This should be a consideration in the 
prioritization of the selected features. 



Technology Personnel in the Simulator Systems Program Ofi.'ce will need to 
and Cost consider technology and cost issues at the pol^it of finalizing 

Considerations the selection of ISFs. It is suggested that SimSPO personnel 
review the steps immediately above before proceeding. 

The consideration of technology and cost has been reserved for 
the end of the selection procedure because ISF implementation 
costs should not drive the upfront analysis. Ultimately cost 
has a significant impact. Maximization of training effectiveness 



82 

82 

EKLC 



via ISS utilization resales in cost savings over the life of 
the ATD, These cost savings and other ISF benefits are to be 
weighed against the ISF implementation costs. As features for 
Instructor Support are selected, justifications can be found in 
the **Purpose and Intended Use" section of the instructor 
support feature definitions. SimSPO personnel should work with 
Operational personnel after all upfront analysis has been 
completed and a complete assessment of justifications has been 
accomplished for the ultimate cost/benefit tradeoff. 

Appendix F offers background information for SimSPO personnel 
who have technical backgrounds but have limited experience with 
ISS implementations. Major components of the ISS and their 
associated cost factors, implementation tradeoffs, and options 
are included. Sizing and performance information for software 
and hardware component,'^ are also given as examples from selected 
prototype system implementations. 
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Introduction 



After the selection of instructor support features, it is 
necessary for operational personnel to provide more detailed 
information about the tasks to be trained and practiced This 
section of the ISF Guidelines has three purposes: 1) to explain 
why cask specific information is required, 2) to riescrib.' what 
type of information is required, and 3) to provide a format 
that is both convenient to use and that ensures that the 
information to be provided will be complete. 



Background 



Instructor support features (ISFs) are incorporated into 
a simulator by means of an Instructional Support System (ISS) 
The ISS is a subsystem within the ATD designed to reduce the 
instructor's workload during the training exercise. The ISS 
can support instruction in a number of ways. It can simplify 
control of the simulation and simulation variables, select 
displays appropriate to the phase of flight, monitor flight 
parameters and procedures, compute performance measures 
and store data for debriefing and other purposes. In short, it 
can carry out any of the functions described in the definitions 
of ISFs in Section II of these guidelines. By taking over some 
of these functions, the ISS allows the instructor to use his 
time more effectively during the training exercise. He is 
freed to spend more time providing quality, one-on-one 
instruction, rather than dividing his time between the student 
and countless other required functions. 

In the past, instructional features having a direct correlation 
to procedures and curriculum requirements have been incorpor,'itbd 
into ATDs; however the design of these features did not allow ^ar 
easy modifications. Changes in checklists, modification.-? ""to 
approaches/departures, etc, continually change and instru^:clonal 
features which supported these events were quickly outdacod and 
therefore justifiably not used. 



Modular 
Design: 

Task Modules 



To correct this major deficiency, a modular design was developed 
to allow straightforward modifications to the system without any 
software rewrite. The operational training requirements are 
separated into units called task modules. They have a direct 
correlation to a group of files which make up the data base for 
a modular data base driven system. This provides the capability 
to handle operational changes in a timely and economic manner. 

Task modules have an additional advantage. Because they also 
have a direct correlation to training objectives, their 
incorporation into the system d<?sign will help to ensure that 
the ISS is designed to user needs. 
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Tl\^ following paragraph should be added to the software section 
of the specification if the task module design Is chosen: 

"A database shall be developed to parallel the syllabus 
training objectives. The ISS r>hall be driven from this 
data base. An editor for conv^wdetic update and modification 
of this database shall also be developed." 



Required If instructor support features are to be incorporated into 

Information an ATD using the task module concept, then the ISS needs 
certain information to be able to implement them. In designing 
an ISS, the user states what the ISS should do by specifying 
wh ich I S Fs to incorporate . Howeve r , in order to recogniz e 
how and when to activate/de- activate iSFs, the ISS also needs 
to have more specific Information about the tasks to be trained 
and practiced. 



Example The following is a brief description of a TAKEOFF procedure and 

an example of the types of information which might be required: 

o St^y^ copdi[.tlon5, for the task: 

(e.g., Value for airspeed is greater than zero and 
accelerating) 



o fiiBE-£fUlit£iSIia the task: 

(e.g.. Airborne with gea - vid flr.ps up) 

o The j ^splays to be presented to the instructor: 

(e.g., Plan view of runway and appropriate cockpit 
instruments) 



o Performancft regutreq: 

(6*g*» Specify Maximum Centerline Deviation allowed) 

(e.g.. Rotated below specified rotation speed) 

This type of operational information must be supplied by the 
using coinmand. Through the use of task modules, personnel in 
the using command can specifically state the conditions under 
which t?:aining support functions will be provided by the ISS. 



Two types There are two basic types of task modules: flight and procedural, 

of task Modules related to the control of flight parameters and modules 

modules: related to procedural actions are basically different from the 

viewpoints of both instruction and implementation. 
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Flight 



Procedural 



Flight task modules involve monitoring continuously changing 
flight variables and measuring the amount of deviation from a 
desired value. 

Procedural task modules involve monitoring events (either 
discrete switch actions or instantaneous values of variables) 
and measuring whether all the right actions were taken in a 
correct order. 

While the basic distinction between task module types is flight 
and procedural, it may be convenient to further subdivide these 
types into categories for normal, emergency, and tactical 
flight. 



Six 

Categories 

Normal 
Flight 



The resulting six categories (with examples included) are 
listed below, 

I^ormal Fl^ S ht Task ModuUs are the type of task modules which 
pertain to the flight segments of a training scenario. These 
are pilot actions which directly relate to the control of 
flight parameters. The following is a sample list of this type 
of module: 



Normal 
Procedures 



o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 
o 



Taxi 
Takeoff 

Climb (non-controlled) 

Climb (standard instrument departure) 

Cruise (non-controlled) 

Enroute (point to point controlled) 

Descent (non-controlled) 

Descent (controlled) 

Holding 

High Altitude Pen : ration 

Low Altitude Pen \, >.tion 

GCA (precision final approach) 

GCA (non-precision final approach) 

ILS final approach 

Non-controlled visual approach 

Landing 

Landing roll out 

In-flight basic instrtiment maneuvering (S patterns) 
Aerobatic maneuvering 
Inflight refueling 



R^m^X Fropedurfif; Tfisk Modules are the type of task modules which 
pertain to the normal procedural ^.^-irjts the student must 
accomplish. These are flight crew actions In the cockpi^ other 
than direct flight control. The following is a sample • ist of 
this type of task module: 
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o Pre-start checklists 

o Start checklists 

o Post start checklists 

o Pre-taxi checklists 

o Pre- takeoff checklists 

o Takeoff checklists 

o Post take off checklists 

o Climb checklists 

o Pre-descent checklists 

o Penetration checklists 

o Pre- landing checklists 

o Landing checklists 

o Post landing checklists 

o Pre-shutdown checklists 

o Shutdown checklists 



Emergency Efnei^gency froc iuyes Task ^^odules are the type of task modules 

Procedures which pertain *> the procedural events in handling aircraft 
system malfunctions. This type of task module is aircraft 
systems specific; therefore the following is a list of common 
aircraft systems which this type of task module would most 
likely fall under. 



o Hydraulic malfunctions 

o Electrical malfunctions 

o Flight control malfunctions 

o Fuel malfunctions 

o Engine malfunctions 

o Environmental control malfunctions 



Emergency Emergency Flight Task Modules are the type of task modules 

Flight which pertain to aircraft flight control while handling an 

emergency. The following is a sample list of this type of 

task module: 

o Single engine landing (or less than all engines) 
o Landing gear malfunction landings 

o Land /^SAP (e.g., low fuel - re-routing quick descent) 
o Blown tire on landing 

o Less than optimum configuration landing (e.g., no 

flaps) 
o n-f light fire 

o lingine failure on takeoff (abort) 
o Engine failure on takeoff (no abort) 
o Blown tire on takeoff 
o Engine restart procedures (in flight) 
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Sro^rdur.. Wea pons Proced ure^ ta sk Modules are the type of task modules 
Procedures which pertain to the procedural actions in operating weapons 
related equipment in the cockpit. This type of task module is 
weapons specific; therefore the following sample list is very 
broad :.n scope. 

o AAI radar search procedures 

o Weapons control panel procedures 

o ECM systems procedures 

o AEW systems procedures 



lllfll^ f . U fi ht Tactics Task Modules are the type of task modules which 

iactlcs pertain to aircraft tactical maneuvering. This type of task 

module is weapons Task Modules specific.- therefore the following 

sample list is ver broad in scope. 



o Low-altitude bomb run 

o 2 V 1 VXD 

o SAM defensive maneuver 



A task commonelity analysis, found in Appendix E, may be used as 
an initial step in identifying task modules for specific ATDs . 



Other As a detailed checklist of items to be included, the task 

?on!?S '° '""^ ^"^"^"g ^"^ly=^ in specifying 

Considerations system requirements. The following are examples of some oftht 

operational considerations which should be addressed when 
describing these tasks: 

Bisp . la y Re quiremen t;:. Any graphic display requirements specific 
to the task module should be specified (e.g., HI TACAN NO 1 
approach plate with a non-erasing history J:rail of the aircraft 
flight path) 

t j e . agvireniepts. . Tl>.e measurements expected to be taken should 
be defined. The following are examples: 

o Airspeed (IAS. CAS, MACH) 

o Heading (degrees, true, magnetic) 

o Altitude (feet AGL. MSL) 

o Vartf-^a ■ .1 (feet per second) 

o Rate .f (degrees ner second, standard rate) 

o Acceleratf.on (Gs) 

o Position (lat/Ioiit. radtal/distance) 

o Angle of Attack Cuv.lti specific to A/C) 

o Switch positions (for procedural tasks) 

o Aircraft conf igur&tion 
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Measurement TvPes, . How the measurements are to be taken should 
be addressed. The following are examples: 

o Continuous over a period of time with start stop 
conditions . 

o transform selection 
sampling rate 

o Single measurement (snap shot) 

logic when to take the measurement 

o Reaction time and time to complete a procedure (for 
procedural tasks). 

Performance Al gor i thms . If automated performance measurement 
Is to be applied, the following are some issues to address: 

o Scoring Procedure 

- weight factors within the objective 
weight factor within the exercise 

o Task difficulty dependent on the environmental 
conditions 

o Task difficulty dependent on other parallel running 
tasks 

Task Module Start Stop Conditions, The following are some 
examples of how to define machine detectable start stop 
conditions: 

o Machine detec":^.ble events 

reaching a flight parameter or combination of 
flight parameters 

arriving at a specified position (lat, long, fix) 
or the closest point of approach to a position 

flying into a cone in space defi^^ed by radials of 
a nav facility and within an alticude band 

any of the combination of the above 

o Operator .inputs 
resets 

changes to I . C. s 

manual insertion o^ ' checklist or malfunction 
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o Task Mod ule Control where the termination of a task 
module will automatically start the next task module 
in sequence. 



Task module formats for the two basic types of task modules, 
normal flight and normal procedure, are presented in Tables IV- 1 
and IV-2. They are provided as guides to be used in the 
development of the two basic types of task modules. These 
formats will also provide guides for emergency and tactical 
types of task modules. The reader is referred to Appendix G 
for examples of two task modules used in an operational system. 



•-^ble IV- 1. Flight Task Module Format 

An introductory heading provides general inforiu^cion relevant to the entire 
task module in the following format: 



Normal Flight Task Module 
(e.g., approach, departure, ILS, etc). 

The operational name of this specific task module 
(e.g,, HI TACAN ONE Luke AFB). 

A concise summary description. 

The flight parameters and or other conditions which 
start this module. 

The flight parameters and other conditions which stop 
this module. 

The ISFs relating to this task module and operational 
information required. 

(e.g.. lOS Display Control and Formatting to put up a 
graphic display appropriate to this task module and 
Real-Time Simulation Variables Control to change the 
environmental conditions). 

TASK MODULg The list of weight factors for the steps within t> ^ 

SCSRiNGitask module. Specify if Automaced Performance Measurement or 
Procedures Monitoring are to be used. 



TYPE : 

mm: 

DESCRIPTION : 
START CONDITIONS : 

STOP CONDITVONS ; 



ISFs nnd RELATEp 
INFORMATION: 
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Table IV- I. Flight Task Module Format - Continued 

Each task module Is further broken down into measurable events called steps. 
This further breakdovm provides more precise points whereby additional support 
features may become active. They are listed in logical order in the following 
format: 



STEP NUMBER: 
DESCRIPTION: 



^Tf^^r CONDITIONS 



^Tp f CONDITIONS : 



The unique sequential number identifying this 
step: 1,2,3, . . . N. 

A statement of the student action to be performed in 
terms of specific aircraft f light/conf igurstion 
parameters 

(e.g., climb to FL 180 upon reaching •'BIC" 
intersection) . 

The flight parameters and or other conditions which 
start this step, 

(e,g., in the case above, a start condition would be 
the closest point of approach to •'BIG" intersection.) 

The flight parameters and or other conditions which 
stop this step. 

(In the case above, when the simulator reaches 18,000 
ft MSL.) 



TSFs and RELATED The ISFs related to this step. 

INFORMATION : (e.g., Malfunction Control to insert "cabin pressure 

failure"). 

Also specify operational information required for 
these ISFs. 

(e.g.. Scoring procedures for Automated Performance 
Measurement, diagnostic messages if desired.) 
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Table IV-2. Normal Procedures Task Module Format 



DESCRIPTION: 
START CONDITIONS : 



STOP CONDITIONS ; 



Ui^, ,^pd REUTSP 
INi^-ORMATION: 



The heading provides introductory, general information regarding the entire 
task module in the follov^ng order: 

TY£S> Normal Procedures Task Module 

(e.g., engine start, taxi checklist, takeoff checklist, 
etc) 

The specific name of the task module 
(e.g., takeoff checklist). 

A concise summary of the content. 

A description of the situation which defines the 
start of this task module; may consist of various 
switches being set, parameters being met, or by 
operator selection, 

A description of the situation which defines the 
completion of this task module; may consist of various 
switches being set, parameters being met, or by 
operator selection. 

ISPs relating to this task module and required 
operational information, 
(e.g,, lOS Display Control and Formatting to put up 
the appropriate display for this checklist) 

Each task module is further broken dovm into steps. This further breakdown 
provides taore precise points whereby additional support features may become 
active. They are listed in logical order in the following format: 

The unique sequential number identifying this step- 
1, 2, 3, ,,.N, 

A statement of the checklist activity to be 
accomplished in this step, generally consisting of 
one checklist item which nay or may not include 
several associated activities. 

If appropriate, a description of the events which 
must have caken place prior to the initiation of this 
step, i,e., prerequisite events. 

To be supplied. 

ISFs relating to this step and required operational 
information. 

(e.g., Procedures Monitoring to detenaine if correct 
procedure was followed and possibly to put up p.t, 
error message if something was done incorrectly). 




CONTINGENCIE S: 



EVENTS : 

ISFs and p EV\T^D 
INFORMATION: 
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GLOSSmOF TERMS 



AIRCREW TRAINING DEVICE (ATD) : A term that refers to synthetic training 
devices (simulators) used in support of aircrew training programs. These 
devices range from simple procedures trainers to more complex training systems. 

ALGORITHM: A precise characterization of a method for solving a problem or 
achieving a goal, e.g., a sequence of actions terminating in a solution. 

BRIEF: Review of events, objectives and procedures wlch aircrew and 
instructional staff prior to simulator session. 

CHECKLIST: series of distinct actions to be performed at discrete times. 

CONTINUATl ' /nUNING: Training conduccod routinely in operational squadrons 
or proflci !c/ training conducted periodically. 

COMVEHSioN TRAINING: Initial qualifying training for a particular type 
of weapou system. 

DATA-DRIVEN: A system that relies on general sofcware which acts upon a 
datafc iae, such that a change to the database would not jsffect a change to 
the flofcware. 

DEBRIEF: Review of event results wich aircrew and Instructors subsequent 
to simulator session. 

FIDELITY: How closely the simulation reflects che actual performance of the 
aircraft. 

INITIALIZATION: Initialization involves specifying, usually from tlid 
instructor/operator console, the parameters of Interest and their values for 
positioning and configuring an ATD within a gaming area. 

INSTRUCTOR SUPPORT FEATURE (ISF): Feature, provided by the ISS to aid the ATD 
instructor In conducting the trainlivg exercise. See Section II for a complete 
list of ISF definitions. *^ 

INSTRUCTIONAL SYSTEMS DEVELOPMENT (ISD); Procedural approach to the analysis 
of training requirements and the development of training programs and systems. 

INSTRUCTOR/OPERATOR STATION (lOS) : The aircrew training device man-machine 
interface where active control ond monitoring of training events occurs. 

INSTRUCTOR SUPPORT SYSTEM (ISS): Automated system within the ATD designed to 
aid the instructor in performing the training function. 

OFF-BOARP STATION: Instructor/operator station which is outside cockpit. 
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OFF-LINE: Any action not associated with active training on the simulator. 
(Operations on the remote graphics brief /debrief station is off-line) 

ON-BOARD STATION: Instructor/operator station which is Inside cockpit. 

ON-LINE: Controlled directly by a computer. 

OPERATIONAL FLIGHT TRAINER (OFT): A device which dynamically simulates the 
flight characteristics of the designated aircraft to train flight crews 
in cockp it procedures , instrument flight procedures , emergency procedures , 
communications and navigation procedures, and includes limited mission 
execution. 

SAMPLING RATE: The temporal frequency at which a stated variable (parameter) 
may be recorded or examined by an automated performance measurement system. 

SCENARIO: A predefined sequence of training events used to exercise the 
capabilities of an ATD in a specific area of intended training usage. 

SIMULATION SYSTEM: That part of the ATD that provides aircraft dynamics and 
the environmental conditions. 

STATEMENT OF OPERATIONAL NEED: A general statement of requirements prepared 
by one of the Air Force Major Commands. 

TEIAINING OBJECTIVES: Explicit statements of the goals of training including 
tasks to be performed, the performance standards for each task, and the 
conditions under which those tasks are to be performed. 

TRAINING REQUIREMENTS: General statements of task performance skills required 
for operational proficiency. Also, general statements of performance skills 
that require periodic practice in order to maintain proficiency. 

TRANSITION TRAINING: Training for aircrew members transitioning to different 
operational aircraft. 

UNDERGRADUATE PILOT TRAINING: Initial pilot flight training. 
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ABBREVIATIONS AND ACRONYMS 



A/C 


aircraft 


ACM 


air combat maneuvering 


AFB 


Air Force Base 


AFTS 


Adaptive Flighc Training System 


AGL 


above ground level 


Airn 


automated performance measurement 


ARPTT 


aerial refueling pare- task trainer 


ASD 


Aeronautical Systems Division 


ASR 


advanced surveillance radar 


ATC 


Air Training Command 


ATD 


aircrew training device 


BFM 


basic fighter maneuvers 


CAS 


calibrated air speed' 


CDR 


critical design review 


CPA 


closest point of approach 


CPT 


cockpit procedures trainer 


CRT 


cathode ray tube 


D.C. 


direct current 


bon 


electronic countermeasures 




grouna con tro ilea approacn 




grouna controlled intercept 


HUD 


head-up display 


T A C 
IAS 


indicated air speed 


I . c , 


initial condition 


ir r 


identification friend and foe 


IFR 


Instrument Flight Rules 


ILS 


Instrument Landing System 




Inertial Navigation System 


lOS 


instructor/operator station 


ISD 


instructional system development 


ISF 


instructor support feature 


ISS 


Instructional Support System 


MAC 


Military Airlift Command 


MAJCOM 


major command 


HRM 


medium range missile 


HSL 


mean sea level 


NAVAIDS 


navigational aids 


NDB 


non-directional beacon 
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ERIC 



OAP 
OFT 



offset air point 
operational flight trainer 



PAR 


precision approach radar 


PIDS 


prime Item development specification 


R&D 


research and development 


REO 


radar electro optical 


SAG 


Strategic Air Conunand 


SAM 


surf&ce<-to*>air missiles 


SID 


standard Instmment departure 


SlmSFO 


Simulator Systems Program Office 


SMS/FNCP 


storage management system and fuel navigation control panel 


SRM 


short range missile 


TAG 


Tactical Air Conunand 


TACAN 


tactical air navigation 


UPT 


Undergraduate Pilot Training 


WST 


weapon system trainer 


Wx 


weather 



ERIC 
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ISF INDEX 



automated d^nstration 

(see autoaated simulator dexaonstration) 
imtrOW%t6d psriRonmiM ■MsuNBontt 

10, 16, 20, 28t 34, 42t 57-€0f 62, 63f 66, 68, 80, 92, 93, 94 
aatoMtad sUnlator dMoostrmtlon, 

10, 46, 50, 53-55, 79 

htLmrim atlUUM, 

10, 15-17, 67, 68, 77, 82 

craah/klll override 

(see freeze) 
current atatua displays 

(see ICS dlaplay control and jtoroattiog) 

data recording 

(see data atorafie and analyala) 
data starage and analyals, 

10, 16, 58, 67--69, 81 

doaonatration 

(aee automated almulatqr dex&onatration) 

10, 25, 31, 32, 34, 35, 37, *5-»8, 49, 50, 51, 53, 54, 55, 66, 79 
graphic dlaplaya 

(aee IDS dlaplay control and formatting and remote graphlca replay) 
graphic replay 

(aee remote graphlca replay) 

bardoopy/prlntoot, 

10, 61-63, 78, 94 

Initial ooDdltlona, 

10, 20, 25-26, 27, 28, 33, 78 
JOS dlaplaj contn^l and fonHLttlng, 
10, 37-39, 42, 79, 81, 93, 95 

MlTimotloii Qontrol, 

10, 27, 28, 29-32 

off-line replay 

(aee rraote graphlca replay) 

paraaetera nonltorlng 

(aee autoaated performance meaaurement) 



performanoe aeasurement 

(aee autoaated performance aeasureaent) 
preprogrammed mission aceoarlos 

(9«e scenario control) 
printout 

(966 bardcopy/printout) 
proo«dw6a aoiiltorliicp 

10, 31, 41-*3, 58, 79, 93, 95 
programed mission scenarios 

(see scenario control) 

Mal«>tlM fllnlation TariaUea oontrol, 

10, 20, 27-28, 78f 93 
recordkeeping 

(see data storage and analysis) 
record/playback 

(see fliaulator record/replay) 
recorded briefings 

(see briefing utilities) 

10, 26, 28, 33*35, 78 
remote brief ing/debrleflng console 

vsee remote graphics replay and briefing utilities) 
MMte grapiaos replay, 

10, 58, 62, 65-66, 81, 82 

soenarlo oontrdf 

10, 19-24, 25, 27, 28, 31, 3^, 77, 78 
slfflulatlon variables 

(see real'^time slaulatlcn variables control and Initial conditions) 
slAolator reooPd/repXay, 

10, 46, 49-52, 5M, 79 

slew 

(see reposition) 

tutorial I 

10, 13-14 1 76 

vebicle oontrol 

(see real'*time simulation variables control) 
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APPENDIX A 



AIRCREW TRAINING DOCUMENTATION 



A-10 

Flight Objectives Pamphlet (8/84) 
Gradesheet 

lOS Manual, Upgrade Training Course (not dated) 
TAC Syllabus (8/84) 

B-52 

Console Familiarization Course (1984) 

Test Option 5 Scenario Description (not dated) 

Training Program WST Coursebook (not dated) 

WST OlS Console Operations Guide Vol. I and II (8/84) 

WST DDS Console Operations Guide (8/84) 

C-130 

Flight Simulator Operating Instructions (10/82) 

Instructor Guide Part II. Pilot Requalif ication/Upgrade Course (1/83) 
Instructor Guide, Navigator Mission Qualification (12/82) 
Mission Profiles I - V (not dated) 

NuHmeyor, R.T.. and Rockway, M,R, Eff ecti'^eness of Weapon System 
Trainers for Tactical Aircrew Training. In Proceedings of Inter- 
service/Indus try Training Equipment Conference and Exhibition, 
October 1984. 

Partial Preliminary Simulator Instructor Guide for Tactical Mission 

Qualification Training (12/82) 
Pilot Study Guide Part I, Pilot Initial Qualification Course (10/82) 
Student Study Guide Part II, Tactical Mission Qualification Training 

(12/82) 

0-141 

Flight Instructor Guide, Navigator Airdrop Mission Qualification Course 
(3/83) 

Flight Instructor Guide, Pilot Initial Qualification Course (1/81) 
IniJtructor Guide, Pilot Airdrop Qualification Course (11/83) 
Instructor Malfunction Guide. Flight Engineer Initial Qualification 
bourse (3/84) 

SIM/CPT Instructor Guide. Pilot Initial Qualification Course (11/82) 
Task and Objectives Document. Loadmaster Airdrop Qualification Course 
(10/81) 
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F-15 

Instructor Operator Guide, F-15 Simulator (7/83) 

Operational Training Course (10/81) 

Simulator Instructor Pilot Upgrade Procedures (7/83) 

F-16 

Basic Operational Training Course (1/84) 
Grade sheets 

Instructor Handbook (3/82) 
Wordstar I-esson Pl-ans (1984) 

KC-135 

Navigator WST Cour sebook (1/8^*) 
Pilot WST Coursebooh (1/84) 

T-37 

Instrument Program (3/83 and 9/84) 

Syllabus of Instruction for Undergraduate Pilot Training (T-37/T'38) (8/83) 
T-50 IFS Mission Guide (3/83) 

T.38 

Syllabus of Instruction for Undergraduate Pilot Training (T-37/T'38) (8/83) 



Advanced Instructional Systems Documentation : 

AFTS (F426000-77-C-2581) 

AFT Program Description (5/72) 
Automated Weapon System Trainer (6/70) 

Grunzke, P. Evaluation of the Automated Adaptive Flight Training System's 
Alr-Co-Alr Intercept Performance Measurement. AFHRL-TR-78-23 . Air 
Force Human Resources Laboratory, Williams Air Force Base, AZ. July 
1978. 

Performance Specification for AFTS for A-7D (6/78) 
Performance Specification for AFTS for F-4E (6/78) 
Program Source Listings 

Software Users Guide for AFTS for F-4E (4/79) 
Training Specification for AFTS for A-7D (6/77) 
Training S;>cclf Icatlon for AFTS for F-4E (7/78) 

B-52 ARPTT ISS (F04604.81-C-0030) 
ARPTT Training Program (5/84) 
Functional Design Doctiment - ARPTT ISS (11/84) 
Instructor Guide, B-52 Training Program Pilot BPAT (not dated) 
Program Source Listings 

Study on the Refurbishment of Aerial Refueling Part Task Trainer (ARPTT) 
to Extend Its Life Expectancy - Technical Report (10/81) 

A-2 
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5A PMS (F33615-78-C-0027) 

C-5 Course Summary Document, Pilot Initial Qualification Course (1/82) 
C-5 Pilot Master Task Listing (3/83) 

CPT/SIM/FLT Student Guide, Pilot Initial Qualification Course (2/81) 
CPT/SIM/FLT Instructor Guide, Pilot Initial Qualification Course (1/83) 
Operations Manual - PMS for the C-5A Simulator (9/83) 
Program Source Listings 

Svink, T.R., Butler, E.A. , Lankford, H.E., Miller, R,M. , Watkins, H., and 
Waag, W.L. Definition of Requirements for a Performance Measurement 
System for C-5 Aircrew Members. AFHRL-TR- 78-54. Air Force Human 
Resources Laboratory, Williams Air Force Base, AZ. October 1978. 

System Specification (Parts I, II and III) (12/82) 

Waag, Wayne L. and Hubbard, Davlt\ c. Th& Measurement of C-5A Perfor- 
mance. In Proceedings of t4s:ci\ology DOD Symposium, U.S. Air Force 
Academy, April 1984. 

14 ISS (N61339-78-C.0108) 

Bosworch, L.K. , Kryway, J.T., and Seidensticker, S.S. F-14 Instructional 
Support System (ISS) Weapons System Training (WST) . NAVTRAEQUIPCEN 

80- C-0056-1. Naval Training Equipment Center, Orlando, FL. March 
1981. 

F-14 Instructional Support System (ISS) Final Technical Report. 

NAVTRAEQUIPCEN 78-C-O108-1. Naval Training Equipment Center, Orlando, 

FL. June 1982. 
F-14 ISS Operational Design (not dated) 
F-14 ISS System Development Notebook Vol. I (not dated) 

Osborne, S.R., Semple, C.A. , and Obermayer, R.W. Three Reviews of the 
Instructional Support System (ISS) Concept. NAVTRAEQUIPCEN 81-C-- 

0081- 1. Naval Training Equipment Center, Orlando, FL. March 1983. 
Program Source Listings 

Semple, C.A. , Vreuls , D., Cotton, J.C., Durfee, D.R. , Hooks, J.T., and 
Butler, E.A. The Functional Design of an Automated Instructional 
Support System for Operational Flight Trainers. NAVTRAEQUIPCEN 
76-C-0O96-1. Naval Training Equipment Center, Orlando, FL. January 
1979. 
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APPENDIX C 
SAMPLE SPECIFICATION 



The purpose of the sample specification provided, beginning on page C-12, is 
Co illustrate the use of these guidelines in defining instructor support 
features for an ATD specification. It was developed using the procedures 
described in Section III of this document. The resulting specification is a 
functional baseline: Once budgetary constraints are known, SiraSPO personnel 
can then perform cost, technology, and benefit tradeoffs. 

Meetings were held with the TAC ISD Squadron's F-16 training program represen- 
tatives at Luke AFB in order to identify their specific training and instructor 
support system requirements. This sample specification was developed using a 
general description of the device and training to be accomplished. The 
assumptions made include: 

o A complete front end analysis has been performed. 

o The instructor will operate and control the device. 

o The anticipated use rate is between 8-12 hours per day. 

FRONT END ANALYSIS 

G_eneral Description - The sample specification is for an F-16 OFT- type device 
with a remote instructor/operator station. It will have a limited field-of- 
view visual system and a generic digital radar landmass presentation. The 
device will be used for basic weapon system training in addition to the basic 
safety of flight objectives. Continuation and conversion training will be 
conducted on this device. The following is a general description of the 
training capabilities required of this ATD. 

Provide Basic Safety of Flight Training 

o Emergency Procedures 

o Degraded Flight Conditions 

o Checklist and Procedural Training 

o Normal Flight Training 

o Instrument and Navigation Training 

o Standardization Training/Evaluation 

Provide Basic Tactical Training 

o Air-to-Air Training Phase 

- Air-to-Air Intercepts (1 to 4 bogies) 

- Air-to-Air Sensors Use 

- Air-to-Air Weapon Employment 

- Intercept Tactics to Merge Plot (Visual on bogie) 

- Clear Air Environment (Non-ECM) 
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o Air- to-Ground Training Phase 

- Low Altitude Tactical Navigation (DR/lSS/sensors) 

- Air- to-Ground Sensors Utilization 

- Air-to-Ground Weapon Delivery 

gt:.uc?_eT^ t Skill and Kqowl^dge Level - Continuation and conversion training will 
be caught on this device. Training will range from familiarization to full 
mission scenarios. The conversion student is most likely unfamiliar with the 
mission of the aircraft, weapon system use, and/or the cockpit controls and 
displays. 

Tra^.nlng Task Objectives • The following training task objectives will be 
taught using this device. They are grouped according to task module type (see 
Section IV, "Providing Operational Information"). 

Normal Proce^tupe? Normal Flight 



o 


Cockpit Checks 


o 


Takeoff 


o 


Before Engine Start 


o 


Standard Instrument Departure 


o 


Engine Start 


0 


Instirximent Navigation 


o 


Before Taxi Checks 


o 


Point to Point Navigation 


o 


Before Takeoff Checks 


o 


Unusual Attitude Recovery 


o 


Penetration Checklist 


o 


Steep Turns 


o 


Landing Checklist 


o 


Holding 


o 


Before Engine Shutdown Checks 


o 


Instrtiment Penetration 


o 


Engine Shutdown Checklist 


o 


InstrtimeuC Final Approach 


o 


Radio Communications 




(TACAN/ILS/PAR/ASR) 


o 


INS Update 


o 


Missed Approach 






o 


Land Ing/Ro 1 1 - out 



Emergency Procedures 

o Abnormal Start 

o Engine Malfunctions 

o Electrical Malfunctions 

o Hydraulic Malfunctions 

o Flight Control Malfunctions 

o Alrstart 

o Fire 

o Jettison Procedures 

o Landing Gear Malfunctions 



Emergency Fligt>t 

o Aborted Takeoff 

o Precautionary Landing 

o Degraded Flight Conditions 

o Arrested Landing 

o Minimum Fuel Profile 

o Asymmetrical Load Approach 



Flight Tactics 



o SMS/FNCP Programming 

o REG Set Up 

o Fence Check 

o Radar Set Up/Checks 

o Ordnance Arming 

o Radar Search Pattern 

o GCI/AWACS Procedures 



o Radar Target Acquisition 

o Collision Course Intercept 

o Stem Conversion Intercept 

o Vertical Attack 

o Weapon Selection/Employment 

o Intercept Control 

o Low Altitude Tactical Navigation 



C-2 

110 



o Radar Position Update 

o HUD Update 

o Altitude Calibration 

o Communication Procedures 



o Air-to-Ground Ordnance Delivery 

( Leve 1/D ives/Lof t/Tos s/OAP ) 
o System/Manual Ordnance Delivery 
o Escape/Evasive Maneuvers 



Training Syllabus - For the purpose of this sample specification, three 
training scenarios have been developed based on the training objectives and 
perceived user training requirements. 

o Scenario 1 • End- to- end training from cockpit entry to engine 
shutdown. It includes normal procedures and flight objectives, 
emergency conditions and basic air-to-air intercepts and weapon 
employment. Training objectives include: 



o Cockpit Checks 

o Before Engine Start Checks 

o Abnormal Start 

o Normal Start 

o Before Taxi Checks 

o Before Takeoff Checklist 

o Takeoff 

o Standard Instrument Departure 

o Engine Emergency 

o Airstart 



o Radar Checks 

o Fence Check 

o Air- to-Air Intercept (single target) 

o Air -to -Air Weapon Employment 

o Holding 

o High Altitude Penetration 

o GCA 

o Missed Approach 

o ILS 



o Landing/Ro 1 1 - out 

o After Landing Checks 

o Engine Shutdown 



Scenario 2 - The simulator is initialized at the end of the runway 
with the engine running. Emphasis is on normal flight task (T/0, 
SID, approach), low altitude tactical navigation and air-to-ground 
weapon delivery. The training objectives include: 



o SMS/FCNP Programming 

o Before Takeoff Checklist 

o Takeoff 

o Standard Instrument Departure 
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o 


INS Update 


o 


Low Level Navigation Route 


o 


Altitude Calibration 


o 


Ordnance Arming 


o 


Laydown Weapon Deliveries 


o 


Escape Maneuver 


o 


Selective Jettison 


o 


Holding 


o 


High Altitude Penetration 


o 


TACAN Final Approach (Asynunetrical Load) 


o 


Landing 



o Scenario 3 - Emphasis is on air-to-ground tactical training. The 
aircraft is initialized airborne at the bombing range entry point. 
Air- to - ground ordnance delivery training , multiple runs . The 
training objectives include: 



o 


Ordnance Arming 


o 


Manual Deliveries 


o 


System Deliveries 


o 


LADD Deliveries 


o 


LOFT Deliveries 


o 


Manual Strafe 


o 


System Strafe 


o 


F-^-irgency Jettison Procedures 



After the oprational ..-raining requirements were identified, the instructor 
training requirements were analyzed according to the procedure described in 
Sction III, "^Selecting Instructor Support Features". Each training objective 
was specified in terms of instructor control and monitoring requirements, and 
instruction and evaluation aids. An example of this process is shown in Table 
C-1. The identified ISFs for each training objective are listed in Table 
C-2. The following sections discuss the selection of ISFs according to 
instructor function, 

PRE-TRAINING REQUIREMENTS 

Instructor Training Function - A tutorial aid is necessary to maintain 
instructor proficiency. New instructors will require training at the console 
to become familiar with the system and its operation. Trained instructors 
will require refresher training after prolonged periods of not using the 
device, as this ATD will be used for continuation training where instructors 
tend to be "^casual" users. Instructors require a tutorial capability that 
provides a variety of training levels. A tutorial feature which could be 
used at a remote console could satisfy this need. Additionally, the instructor 
will require an on-line "Help" function at the lOS to access system operation 
reference material during training. 
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Table C-^l. Instructor Training Objective Requirements 



^alnlng 1 


..ilaatcQL 


1 

1 _ Monitor 


L .Znabrufib..,.. 


-1 — Evaluate.. 1 


ike*Off 1 


0 Envlrotment 


1 0 Visual Scene 

1 0 lD8trUIDeDt& 

I 0 A/C Configuration 


1 0 Freeze 


1 0 Procedures Honltorlng j 
1 (Take**off parameters) j 


andard I 
istruiaent j 
iparture j 


0 Envlroment 


1 0 Flight Profile 
1 0 Inatrunenta 
I 0 Na\r. Equip. 


1 0 Freeze 


1 0 Automated Performance | 
1 Measurement j 
1 0 Procedures Honltorlng | 
1 (Navigation/Flight I 
j Parameters) | 
1 0 Display Format (map w/ 1 
Historical Trail) 


r to Air 1 


0 Target and 
Fighter Relative 

p03ltlCD 

0 Target Flight 
Paraseters 


I 0 Tactical situation 
1 0 Cockpit tactical 
1 displays 1 sensors 
1 and controls 
I 0 Target/Fighter 
1 Flight Parameters 


1 0 Freeze 

1 0 Secord/Seplay 


i 0 Display Format j 
1 (Tactical situation w/ I 
1 Historical Trail) | 
1 0 Procedures Monitoring | 
I (Flight and Geometry j 
1 Data at various ranges) j 


r to Ground 1 
^apcn 1 
divery j 

1 


0 Bnvlronnaent 


1 0 Visual Scene and 
1 BUD 

1 0 Flight Parameters 
1 0 Weapon Status and 
1 Selections 


1 0 Freeze 


i 0 Automated Performance | 
1 Measurement (Veapons j 
1 Scoring) 1 
1 0 Procedures Honltorlng | 
j (Aircraft Release | 
1 Parameters) | 
I 0 Display Format j 
1 (HUD Display) I 
1 1 
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Table C-2. Identified ISFs for Training Objectives 



i 



yoRl^ AL PR0CEPURE3 

o Cockpit Checks 

o Before Engine Start 

o Engine Start 

o Before Taxi Checks 

o Before Takeoff Checks 

o Penetration Checklist 

o Landing Checklist 

o Before Engine Shutdown 

Checks 
o Engine Shutdovm 
Checklist 
INS Update 

EMERGENCY PROCEDURES 



Training Objective 



o Abnormal Start 
o System Malfunctions 
o Airs tart 
o Fire 

o Jettison Procedures 
T ACTICAL PR OCEDURES 



o REO Checks 
o Fence Checks 
o Radar Set -Up Checks 
o Ordnance Arming 
o Radar Search Pattern 
o HUD Update 
o Altitude Calibration 

NORMAL FLIGHT 



i 



Takeoff 
SID 

Enroute Nav 
Unusual Attitude 
Recovery 
Steep Turns 
Holding 



FR2 



X 
X 
X 
X 
X 
X 
X 
X 
X 
X 
X 
X 



X 
X 



REC/ 
REP 



DEMO 



VAR 
CTRL 



i. 



MALE 
CTRL 



X 1 


1 1 1 X 


X 1 


X 1 


X 


X 1 


1 1 1 X 


X 1 


X 1 


X 


X 1 


1 1 1 X 


X i 


X 1 


X 


X 1 


1 1 1 X 


X 


X 1 


X 


X 1 


1 1 1 X 


X 


X 1 


X 


X 1 








X 


X 1 






X 


X 


X 1 








X 


X 1 






X 


X 


X 1 








X 


X 1 








X 


X 1 








X 


X 1 






1 X 


X 


X 




1 X 


X 


1 X 


X 




1 X 


X 


1 X 


X 


X 1 1 1 




1 X 


1 X 



APM 



X 
X 



PROC 
MON 



X 
X 
X 
X 
X 
X 
X 
X 

X 

X 



X 
X 



J. 



FRZ - Freeze 

REC/REP Record/Replay 
DEMO demonstration 
VAR CTU v 

variable Control 



HALF CTRL - Malfunction Control 

APM ■ Automated Performance Measurement 

PROC MON - Procedures Monitoring 

DSPL FRMT - Display Format 
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Table Identified ISFs for Training Objectives - Continued 



j 1 

1 Training Objective | 


1 


p TTP y i 

KiliO/ 1 


1 


IT A T5 1 

VAR 1 


MALF 1 




1 

PROcj 


1 

DSPLI 


FRZ 1 


REP 1 


DEMOl 
I 


CTRLI 


CTRL 1 


APM 


MOM 1 


FRMTI 

1 


1 1 
1 NORMAL FLIGHT CContlnuGd^ j 


1 
1 


1 
1 


1 
1 


1 
1 






1 
1 


1 


|o Inst. Penetration | 


X 1 


1 


1 


1 




X 


X 1 


^ 1 


lo Inst. Final Ann 1 


1 










X 


X 1 


X j 


1 o Missed App. j 


X 1 




1 








X 1 


X j 


jo Landing Roll-Out | 


X 1 


1 


1 


1 






X 1 


X 1 


1 1 

1 EMERGENCY FLIGHT | 


1 
1 


1 
1 


1 
1 


1 






1 


1 


|o Aborted Takeoff | 


X 1 


I 


1 


1 


X 1 


X 1 


X 1 


X ! 


jo Degraded Fit. Conditions! 


X 1 


1 


1 


1 


X 1 




X 1 


X 1 


jo Minimum Fuel Profile j 


X 1 


1 


1 


1 




X 1 


X 1 


X 1 


|o Precautionary Approach j 
j I 


X 1 


1 


1 


1 


X 1 




X 1 


X 1 


1 TACTICAL FLIGlfT ] 


1 
1 


1 
1 


1 
1 


1 






1 


1 


|o Air- to-Air Intercept | 


X 1 


X 1 




X 1 






X 1 


^ 1 


jo Radar Utilization j 


X 1 






X 1 








^ 1 


|o Air- to -Air Weapon j 


X 1 






X 1 




X 1 


X 1 


^ 1 


j Employment j 


















jo Low Alt. Tactical Nav. j 


X 1 










X 1 


X 1 


X 1 


jo Air- to -Ground Attack j 


X 1 


X 1 


X 1 










X 1 


j Profile 1 


















|o Air- to -Ground Veapon j 


X 1 


X 1 


X 1 






X 1 




X 1 


1 Deliverv j 


.- 1 




L 


L 











FRZ - Freeze MALF CTRL - Malfunction Control 

REC/REP - Record/Replay APM - Automated Performance Measurement 

DEMO - Demonstration PROC MON - Procedures Monitoring 

VAR CTRL - Variable Control DSPL FRMT - Display Format 



Pr . epare Fupction - To prepare for a training event, the Instructor must review 
the training requirements, the event description and student progress In order 
to determine a training strategy. This function could be accomplished at a 
remote console using the Briefing Utility and Data Storage and Analysis 
features. Performing this function at a remote console wou. 1 also allow the 
instructor to tailor the event (see Training Set-up Function) prior to briefing. 

Tpai,nin g Setp-up Function - A capability to tailor the training . event off-line 
(at a remote console) can provide more available training time. It Is 
anticipated that available training time is at a premium due to the high 
utilization rate assumed. This requires that the instructor be able to select, 
modify and develop training scenarios using Scenario Control, Initial Conditions 
and Malfunction Control features. 



c-7 116 



no^roln r. Tr«tntng Funct lQP - As mentioned above in the Training Set-up Function. 
S r lnstluctSr Sust"ha ^the capability to tailor training to meet the students 
need In addition, there must be a utility which allows the training curriculum 
manaeers to develop totally new training objectives to meet changes in aircraft 
equipment tactical tapes aud defined mission requirements. These ^odif ications 
to the set of training objectives must be able to be made easily and in a 
timely manner. 

Rr-fP.f Function - The training effectiveness of any system is directly related 
to ^ the quaU ty of the brilfing and debriefing functions For conversion 
training in particular, the brief function sets the tone for the entire training 
event 4e briefing Utility feature provides the student with a complete 
:::^iew of the trainmg eveL. plus graphic displays of task "l-J-^. "f-' 
mation. A capability to present dynamic demonstration of tactical displays 
used Suring intercept and air-to-ground training is considered to be beneficial 
to conversion students. These students are unfamiliar with the weapon system 
and associated displays and will require coaching on how to interpret and use 
lie iT,formation presented. This capability will allow the instructor to 
demonstrate how to use the information and develop a "scan pattern essential 
to mission training. 

TRAINING REQUIREMENTS 

Control Jimctlon - All five identified control features (Scenario Control. 
Initial Conditi ons . Real-Time Simulation Variables Control Mflfunction 
Control and Reposition) are required for this ATD. Scenario Control by 
trrining objective provides the greatest benefit to the instructor by minimizing 
his workload while allowing the flexibility to make real-time changes A 
fully automated Scenario Control capability is required for standardization 
and evaluation training and can be used during ^"^""f "'^^f/^^^^ff.^^i^f ' 
Scenario Control provides a wide variety of initial conditions identified by 
training objectives (e.g.. Hi-ILS Rwy 03R at Luke AFB) . Malfunction Control is 
required foi training and should include the capability to preprogram sets of 
malfunctions at the remote console for manual insertion by the instructor 
during the training event. Real-Time Simulation Variables Control and 
Reposition provide the instructor added flexibility during training to control 
the training event and efficiently use available training time. The Fre..e 
feature may be required to perform some of these control functions. 

Mnn^^nr Function - Due to the instructor offboard location, the JOS I)isplay 
Contro? anSForm atting and Procedures Monitoring features are required Task 
specific and training- related information should be presented to the instructor 
in a meaningful format. 

T p.fra.■^■ Function - The Freeze feature will be used the most to provide 
instruction during training. Due to the student skill level, only total 
system freeze and cfashAiU freeze are appropriate for this ATD. The Simulator 
Record/Replay and Automatic Simulator Demonstration features can be used 
for conversion training of tactical intercepts, air-to-air weapon employment 
low altitude tactical navigation, and air-to-ground weapon delivery. These 
new training tasks require the use of many cockpit controls, displays and cues 
which are new to the student. 



Evaluate _g,unctl on • The Instructor must analyze training relevant information 
to determine if student performance has met specified criteria. This requires 
that the instructor be provided the information in a content and format which 
meet his needs, lOS Display Control and Formatting and Procedures Monitoring 
are required to aid the instructor perform the evaluation function. Procedures 
Monitoring, as defined in Section II, includes the monitoring of flight 
diagnostics which would provide the instructor with a parameter monitor- 
ing and performance alerting capability. For tactical training, weapons 
scoring is necessary for performance results feedback. An Automated Performance 
Measurement feature is required for this capability. Automated Performance 
Measurement should be designed to support specific training objectives as 
would be provided by the Scenario Control by objective feature. This would 
provide an objective, standardized performance measuring capability which the 
instructor can modify if required. It will reduce the instructor's workload 
as well as provide a training effectiveness measure for training curriculum 
managers . 



POST-TRAINING REQUIREMENTS 

D^hrjet , F,unction - This function requires the instructor to provide tlie 
student with a detailed analysis of the training event, identifying strengths, 
problem areas and corrective actions. Performance information is extremely 
useful during debrief and can be provided by the Hardcopy/Printout feature. 
The Remote Graphics Replay feature provides a debriefing tool which allows 
dynamic replay of specified events. This can be very training effective, 
especially for conversion students. 

Record Functloi;i «• The instructor is required to record the student's progress 
and any device deficiencies at the completion of the training event. The Data 
Storage and Analysis feature can provide the mechanism for recording student 
performance and progress and storing pertinent training data (e.g,, student 
records and automated performance measurements, recording and storage of 
training device information). This feature supports the requirements of 
pre- training, curriculum managers, and the ATD managers. 

BENEFIT ANALYSIS 

The benefit analysis will determine the final selection of ISFs for ATD 
specification. ISF selection must be based on specific training requirements 
and the functional needs of the instructor and training system managers to 
enhance training efficiency. Specific items to consider are outlined in 
Section III under the "Benefit Analysis" heading. These items lead to further 
justifications , prioritization, and subsequient selection and rejection of 
ISFs. The results of the benefit analysis for the sample specification are 
shown in Table C-3. 
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Table C-3. Benefit Analysis 



1 Instructor Support | 
1 Feature 1 


1 

Select L 


Re-)ect 


j Reason 1 


{Tutorial 1 


X 1 




[To maintain Instructor [ 
[proficiency. 1 


[Briefing Utility | 


X 1 




[Instructor aid to review syllabus | 
[training and relevant displays, | 
I cues and procedures for student [ 
[ preparation. 1 


1 Freeze | 


X [ 




[Required for instructional | 
[control. 1 


1 Simulator | 
1 Record/Replay | 




X 


[Low identified need. Need | 
[associated with use of tactical | 
[displays. Alternative: Remote | 
[Graphics Display. 1 


1 Automated Simulator j 
1 Demonstration | 




X 


[Low identified need. Alternative,! 
[Remote Graphic Display. | 


[Scenario Control j 


X 1 




[Provides objective -based training j 
[which minimizes Instructor work- j 
[load; provides syllabus tailoring j 
[capability to meet student needs. | 


[Initial Conditions j 




X 


[This control will be incorporated | 
[as part of the scenario control | 
[feature. 1 


[Real Time Simulation 
I Variables Control | 


X [ 




[Required to allow instructor j 
[control of variables. | 


[Malfunction Control | 


X 1 




[Required for training. | 


[Reposition 


X 1 




[Provides efficient use of | 
[available training time and | 
[training flexibility. | 


[Automated Perfor- 
[ mance Measurement 


X 1 




[Aids the instructor in evaluating | 
[student performance. | 


[Procedures 
1 Monitoring 


1 X 1 




[Required for instructor to monitor | 
[cockpit activities. Instructor j 
evaluation aid. 1 

1 1 
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Table C-3. Benefit Analysis - Continued 



1 Instructor Support 
1 Featui^e 


i Select 


1 1 
Reject 1 Reason j 


|IOS Display 
1 Formatting 


1 X 


[Required for instructor | 
1 effectiveness. i 


1 Hardcopy/Printout 


1 X 1 


1 Feedback mechanism for student | 
1 debrief . | 


(Remote Graphics 
1 Display 


1 X 1 


1 Dynamic debriefing capability. | 
|Used as an alternative for | 
1 Simulator Record/Replay and | 
(Automated Simulator Demonstration. 


|Data Storage 
1 Analysis 


1 X 1 


1 Student records and progress | 
[Information. Supports curriculum | 
(managers by providing data to | 
(measure training effectiveness. ( 
1 ^ 1 



C-ll 



120 



SAMPLE SPECIFICATION 



3.7,2 Instructional Subsystem - The F-16 OFT shall be provided the follow 
instructor support features to enhance the efficiency of training. 

3.7.2.1 Briefing Utilities - Briefing utility aids shall be designed 
assist the instructor in briefing a student for an upcoming simulator sessi 
The aids shall prepare both the student and instructor prior to a particu 
exercise and consist of F-16 training material to be used for preparat 
(e.g., lesson guides, training program outlines, and instructor guides). 
Briefing Utilities shall provide the capability to review training ev 
graphics (e.g., SiD and approach plates and emergency procedures), and al 
demonstrations of specific dynamic events (e,g,, intercept tactical displ 
and air-to-ground weapon delivery displays), The instructor shall also be a 
to access student training records recorded by the Data Storage and Analy 
feature described in paragraph 3,7.2.13, This feature shall be accessed on 
off-line remote graphics console and shall not degrade normal training perfor 
on the main lOS. The method of interaction shall be similar to the main 
and shall be easily accessible by the instructor. Briefing materials shall 
functionally grouped in user terms to ensure optimal usability; data 
displays shall be easily modifiable for future updates. A detailed descr 
tion of the briefing data shall be made available at CDR, 

3.7.2.2 Freeze - A total system freeze feature shall allow all Simula 
parameters to be frozen at a given time within a F-16 mission trair 
scenario. The instructor shall have the capability to manually or automatica 
freeze the simulator. Manual total system freeze shall be capable wit! 
single action on the part of the instructor. Automatic total system fre 
shall occur either when specified parameter values are exceeded or w 
the state of the simulator changes, as in reposition or when changing operat 
modes. An automatic fi:eeze override feature shall be incorporated win 
allows the training event to continue uninterrupted, while displayin; 
message to the instructor that che automatic freeze criteria were met. 
override feature will be the normal setting for automatic freeze, 

3.7.2.3 Scenario Control - Scenario Control shall support the instructor 
providing efficient control of the simulation during training and by provic 
student activity by automatically displaying information relevant to 
training being accomplished. It shall provide the capability to configure 
control the ATD in accordance with predefined scenarios covering the 1 
simulator curriculum. Scenarios shall include the initial conditions for 
exercise and the training objectives to be activated in a predefined oi 
and/or under prespecified conditions. The scenarios shall be made avail; 
for review of content and for selection at both the remote graphics com 
and the lOS. The full range of scenario control automation shall be i 
available. This range covers total automation with no instructor input* 
minimal automation where flexible instructor interaction is provided, inclu< 
the options of repeating, deleting, and adding certain objectives, 
interaction shall not require re- initializing the simulator and should 
detract from the overall simulation. ATD configuration changes caused by 
feature shall be automatically checked to preclude any crash conditior 
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other adverse condition and shall freeze the state of the simulator until all 
Incompatible conditions are corrected. A list of scenarios and the data 
specified within each scenario will be made available at CDR. 

3.7.2.4 Real-Time Simulation Variables Control - The Instructor shall be 
provided the capability to insert, delete or alter simulation variables in 
real time. This shall Include variables associated with environmental 
conditions, airfield data, target data (controllable adversary and friendly 
radar targets) and aircraft flight and positional data (ownship, wingman or 
adversary). In addition to preprogrammed profiles, friendly and adversary 
data shall be capable of changes in altitude, ar.titude, speed, acceleration 
and heading, and positioned in relative range and bearing from the fighter 
aircraft via an interactive input device (joystick, trackball, light pen 
etc . ) . 'Oft 

3.7.2.5 Malfunction Control - Malfunction control shall provide the Instructor 
the capability to select a sequence of abnormal aircraft equipment conditions 
and/or emergency conditions before or during the training session. The me^hod 
of insertion during runtime shall depend on the level of scenario control 
automation. In the case of total automation, insertion shall be automatic nna 
triggered by preprogrammed events. In the case where scenario control provi 
instructor flexibility for insertion and removal of certain training objectiv 
the preselected malfunctions shall be made readily available for rur- .e 
accessibility. The time and number of actions required on the part o£ 
instructor to select, alter, and enter malfunctions shall be minimized to ne 
^w^u^^?, ^"^^^""^ possible. This feature shall provide an optional graphics 
which allows the instructor to monitor student procedures related directly to 
the active malfunction, 

3.7.2.6 Reposition - The Reposition feature shall provide the capability to 
position the ATD to any point in the mission training scenario. All flight 
parameters shall be capable of automatic adjustment to meet the new condition 
imposed by repositioning. After reposition, ATD configuration shall be 
automatically checked to preclude any crash condition or other adverse condition 
and shall remain in a freeze state until all incompatible conditions are 
corrected. The reposition feature shall be designed to enhance instructor 
efficiency. The time and the number of actions required on the pare of the 
Instructor to select, alter and enter data shall be minimized, 

3.7.2.7 Automated Performance Measurement - The automated performance 
measurement feature shall aid the instructor in obtaining a valid and reliable 
measurement of student performance. The feature shall be designed to support 
specific training applications and to provide the instructor with a precise 
objective and standardized measure of student performance and a capability to 
simultaneously measure many facets of a mission event. The instructor shall 
be provided timely feedback of performance data in real or near-real time; and 
as an instructor option, shall be displayed on-line for use during a training 
session or off-line for debriefing purposes. The instructor shall have the 
option to override or modify performance measurements provided by this feature 
F-16 curriculum managers shall have the capability to modify ("fine tune") 
performance algorithms on-site. Final determination of automated performance 
measurement algorithms including the parameters to be measured, the methods of 
measurement, and evaluation criteria shall be made at PDR. 
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3 7 2 8 Procedures Monitoring - The Procedures Monitoring feature shall 
provide Che instructor with a method of monitoring the procedural training 
activities of the student. This includes the procedures involved with both 
normal and emergency procedures as specified in the F-16 Flight Manual. The 
data to be monitored shall be easily modifiable to reflect current procedures 
and valid messxJres of these procedural activities. Final determination of 
procedures monitoring activities including a list of the procedures and 
associated data shall be made at PDR. 

3 7 2 9 lOS Display Control and Formatting - This feature shall automatically 
provide the instructor with a graphic representation of student action appro- 
priate to the active training objective. This feature shall also provide 
optional graphics associated with the scenario currently being trained. 
The presentation of information shall be an easy- to -read, uncluttered 
standardized format of the current status of graphical and instructional 
information. To the greatest extent possible, informational display formats 
shall replicate that which the aircrew normally uses (e.g.. a graphic depiction 
of the F-16 HUD should replicate the actual aircraft) . The information layout 
shall be consistent with the limitations of human perception and memory in 
order to minimize user interpretational effort and alleviate contusion, thereby 
ensuring quick recognition and maximizing readability. The default and 
optional displays, display content and display formatting will be determined 
at PDR. 

3 7 2 10 Hardcopy/Printout - The instructor shall be capable of retrieving 
data 'from any specified source within the simulation - i.e.. parameters, 
variables, display content. It shall retrieve the data in such a way that no 
interruptions occur within the simulation and its displays and shall create a 
hardcopy printout of the collected data upon demand without simulation 
disruption. The time and number of actions required on the part ot the 
instructor to activate hardcopy/printout -hall be minimized. 

3 7 2.11 Remote Graphics Replay - The remote graphics replay feature shall 
provide the capability to recreate a graphic replay as viewed from the lOS 
during an active exercise. This feature shall also include the optional 
.Graphics which were .^ade avaiT^ble regardless as to whether they were accessed 
This feature shall be accessed via a remote briefing/debriefing console. It 
shall be capable of operating concurrently with active training without any 
degradation to the performance of the simulator and the lOS. Indexing into 
the playback data by trz-ining objectives, in addition to instructor inserted 
flags during realtime. «hall facilitate locating points of interest in the 
mission. The feature shall also provide viewing in normal or fast speeds. An 
option to freeze any point within the playback shall also be provided. 

3 7 2 12 Tutorial - The tutorial feature shall provide the instructor/student 
with k user-fl endly interactive, self-paced and self-administered program of 
instruction on the capabilities and use of the flight simulator and its 
instructor supr'^rt featurs. The tutorial feature shall include a help 
function in t form of an easily accessible prompt. The tutorial shall 
be provided off-line at a mote console or at the lOS On-line instructional 
sysLm operation in the form of a HELP function shall also be provided for 
the novice or infrequent user) and be accessible to the user as an option. 
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The data provided by this feature shall be easily modifiable to reflect the 
current F-16 training objectives, performance criteria, F-16 alrcraft/ATD 
configuration, etc . 

3-7.2.13 Data Storage and Analysis - The data storage and analysis feature 
shall record pertinent student performance Infoxrmatlon during the training 
session. Access to this Information shall be available In a variety of ways: 
grouped by student, student type and class, phase of training, the objectives 
attained, time/attempts to attain the objectives, and conditions under which 
the objectives were met or not met. Such information shall be retained on the 
system as part of a student's record and accessible via the Briefing Utility. 
This feature shall also store information regarding certain aspects of system 
operation (e.g., use of Instructor support feature options) to be used by 
curriculum managers to assess overall ATD training effectiveness and use. 
This feature shall provide an Interactive data editor capability for admini- 
strative information update at an off-line device which does not Interfere 
with normal simulator operation. The actual data to be stored and analyzed 
will be determined at COR. 

NOTE: The following paragraph Is added to support task module -based design: 

••A database shall be developed to parallel the syllabus training 
objectives. The ISS shall be driven from this data base. An editor 
for convenient update and modification of this database shall also 
be developed. " 
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Training 
Device 



AFTS A-7D 
A- 10 

ARPTT ISS 
B-52 

C-5A PMS 
C-130 
F-15 
F-16 

T-37 (T-50) 
T-38 (T-51) 



APPENDIX D 
TRAINING SITES VISITED 

Location 

Davis 'Hon than AFB 
Davis -Hon than AFB 
Castle AFB 
vestle AFB 
Alcus AFB 
Little Rock AFB 
Luke AFB 
Luke AFB 
Williams AFB 
Williams AFB 



Date 
12/7/8A 

12/7/84, 1/30/85 

1/15/85 

1/15/85 

12/12/34 

12/11/84 

11/15/84, 1/29/85 
11/15/84, 1/29/85 
11/13/84 
11/13/84 
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APPENDIX E 
TASK COMMONALITY ANALYSIS 



Tables E-1 through E-6 present a listing of tasks which are trained in ATDs 
within the four major Air Force Conunands and those incorporated into four 
ISSs. The purpose of this task listing is to compare tasks which are commonly 
trained utilizing ATDs with tasks incoiT)orated into recently developed ISSs. 
This task listing can be used to determine what types of tasks have been 
monitored using an ISS and what types have not. In order to determine 
commonality of tasks, only pilot flight station tasks were included in this 
analysis. This is due to the fact that five of the nine aircraft training 
systems investigated perform pilot only training. 

SCOPE OF THE ANALYSIS 

The identification of training tasks involved a detailed review of training 
documentation, including the simulator training syllabi and instructor guides. 
This documentation describes the general training scenario and the specific 
training objectives for each event. In many cases this documentation did not 
describe the training event on a task-by- task basis. Therefore, to further 
amplify training task requirements, extensive instructor interviews were 
conducted to determine which tasks were monitored during the training sessions. 

The task listing is organized according to task type: Normal Flight, Normal 
Procedures, Emergency Flight, Emergency Procedures, Tactical Flight and 
Tactical Procedures, The tasks which are monitored in the ISSs were identified 
from existing documentation and compared with the previously defined task 
listing. ^ 

ANALYSIS RESULTS 

A strong commonality of simulator training tasks exists throughout normal 
flight, normal procedures, emergency flight and emergency procedures. This 
commonality of tasks is consistent across the Air Force major commands. This 
is as would be expected, since these types of tasks reflect a basic flight 
training philosophy. This philosophy includes ensuring that the aircrew has a 
firm understanding of procedures and limitations of the aircraft, and can 
demonstrate this knowledge plus the motor skill ability to safely operate the 
aircraft under normal and abnormal conditions prior to the first flight. 

The task listing matrix indicates that conversion training encompasses all UPT 
training task requirements. The aircrew is becoming familiar with the new 
systems at their disposal, and is utilizing them to perform the same task 
required in UPT, Primary emphasis is on safety of flight, and the aircrew's 
ability to safely operate the system within the procedures and guidelines set 
forth. This includes starts, take-offs, landings, instrument and basic 
airwork skills, navigation, use of checklists and abnormal situations. Once 
this performance has been demonstrated, the aircrew is introduced to basic 
tactical skills. 
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Most tasks Identified for tact:ical flight and tactical procedures are unique 
for each tactical mission. Ihese tasks, as taught in conversion training, 
provide the basic foundation for continuation training in the operational 
squadrons. The tactical phase of training does contain some common tasks 
which would be applicable actcja ^11 major operational commands. Such 
miss Ion- related taslcs are encompassed in Air- to-Ground Attack and Electronic 
Warfare, 

Nearly aU conversion training tasks In the first four task categories (normal 
flight, r.ormal procedures, emergency flight and emergency procedures) are 
incorporated into the ISS systems under study. Tasks which are not identified 
as monitored by an ISS, were not done so by design. The ISS systems for the 
F-14, B-52 ARPTT and C-5A could be easily modified to monitor these conversion 
training task requirements. 

The APIS for the A-7D and F-AE are the only ISSs designed to monitor tactical 
training. These systems provide alr-to-alr and air-to-ground training, and 
meet the needs of conversion training In these areas. 

A commonality of tasks exists for all ATDs In the Normal Procedures, Normal 
Flight, Emergency Procedures and Emergency Flight task module categories. The 
ISS devices under study currently monitor the major portion of these identified 
task requirements. The task module approach utilized by these ISS devices 
provide a user- oriented system which can be easily modified to encompass all 
tasks in these categories. 

Tasks that address motor skills, e,g,. Normal and Emergency Flight, and tasks 
that deal with performance of procedures, e.g, , Normal and Emergency Procedures, 
can be addressed by the current ISS technology. Some tactical tasks can 
also be addressed utilizing the same technology. 

Tactical training is composed of unique training skills for each aircraft and 
tactical mission. Tactical training at the conversion level consists of defined 
parameters and established guidelines which must be demonstrated in the ATD.. 
Certain tactical training tasks. I.e. low- level navigation and EW training, are 
applicable to all major operational commands. 

Task taught and parameters monitored In conversion training are directly 
applicable to continuation training. Standardized evaluation of operational 
aircrew is required to ensure that they can perform the mission in a safs and 
effective manner. Much of this evaluation can also utilize the current ISS 
technology. 
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TablfB^I. lOm PfiOCBHIRBa TISK MODDLS CATEGOBT 

T37 T36 ilO m F16 C130 KC135 m B52 AT F4 Fl4 B52 CS 

m OFT OFT OPT HST OR VST VST on VST IFTS IFTS m urn PHS 

Bfifore Interior Ms IIXIXXIIX t 

Interior Checks tlttlllXl t 

Before Engine Start I t 

Engine Start X }( K X X X X X X X X 

Before Taxi Checks X X X X X X X X X I X 

TaxiCfaecks X X X X X 
Engine Bud 0p Checks X 

^ Before Take Off Checks X X X X X X X X X X X 

Bunwy Line Up Checks X X 

After Take Off Checks X X X X X X X X X X X 

Climb Checks X X X X X X X X X X X 

Cruise Checks X X X X X 

Descent Checks X X X X X X X X X X X 

Approach Checks X 

Landing Checks X X X X X X X X X X X 

After landing Checks X X X X X X X X X X X 

Before Engine Shutdown X X X X X X X X X I X 

Engine Shutdown X X X X X X X X X X X 
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Table H. WBUL PHOCBDWES IAS HM)1M CAIEGOBI (oont^^^^ 



137 !38 A10 F15 F16 
,431 or (K on HST OFT 

Before IcaviDg Cockpit 
Inflight Refueling Checte 
Crew CoordloatloA 
Crw Briefing 
Pilot Not Flying Reap. 



C130 K135CH1 B52 IT F» Fl* B52C5 

II5T UST OFT HST tfTS IFTS ISS ABPHPHS 

X 

X X X 

XXX X X 

XXX X 
XXX X 



M 

I 

^ 
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wi»t4, mis. am xawm mm 



TI8K 

Take Off 
Noiial 
Afterburner 
Reduced Power 
Assault 

Basio Instruments 
Cliobs 
Descents 
Level Off s 
Straight and Level 
Airspeed Control 
Altitude Control 
Heading Control 



T37 T38 A10 PIS ri6 C130 IC135 m B52 A7 F4 F14 B52 C5 
(W on on HST OFT «ST SSI OFT HSI AFTS AFTS ISS AimPHS 



X X X X X X X XX 



X X 



X X X X X X X X X X X 
X X X X X X X X X X X 
X X 



X X 



X X X X X X X 
X X X X X X X 



Airspeed Changes St/Lvl X X 
Airspeed Changes Lvl Turn X X 



Turns 



Steep Turns 



X X X X 
X X X X 



X X 



X X X X X X X 



Unusual Attitude Recovery X X X X X 
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X 
X 



X 
X 



X 
X 



X X X 
X X X 



X X X X X X X X X X X XXX 
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Tibli B-2. Wm FU6HT m HODDU CiTEQORI (oontiAUtd) 



m 

Slov Flight 
Vertical S Pattern 
ipproaoh to Stall 
lostniBent Navigation 
Course Intercept 
Course Haintenanoe 
Aro Intercept 
Arc Haintenanoe 



Fix to Fix 



Point to Point 
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Ground Speed Check 
PF Steer 



T37 T38 ilO F15 Fl6 CI30 KC135 m B52 A7 n Fll B$2 CS 
on OFT OFT VST OFT VST VST OFT VST tfTS AFTS ISS ABPHPHS 



t X 



X X 



X 



X X X X X X X X X X X 



X X X X X X X X X X X 



X X X X X X X X X X X X 



X X X X X X X X X X X 



X X X X X X X X X X X X 



X X X X X X X XX 



X X 



X X X 



standard In&truoent Dept. X X X X X X X X X X X X 



Enroute Navigation 
INS Navigation 
Holding 
Penetration 
Procedure Turn 



X X X X X X X X X X X X 



X X 



X X X X X X X X X X X X 



X X X X X X X X X X X X 



X X X 



X 
X 
X 
X 
X 
X 



X 

X 
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Table &-2. lOBHlL FUGHT tlSX. HQDDLB CATEQOfil (oontlouid} 



m 

Precision Approaob 
ILS 
OCA 

Coupled 
Non-Preolslon Approach 
TACAH/VOB 

m 

Back Course 



SI 



SurvelUanoe Approach 
Hissed Approach 
Airborne Radar Approach 
Circling Approach 
Formation 
Hlndshear 

Confidence Maneuvers 
Loops 
Wing Overs 
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T37 138 AlO F15 P16 C130 K135 CUl B52 A? n FH 852 C5 
OFT OFT OFT VST OFT VST H8T OFT VST AFTS AFTS ISS AtPTTFMS 



X X X X X X X X X X X 
X X X X X X X X X X X 



X X X X X X X X X X X 
X X X X X X X X X X X 



t X 



X X X X X X X X X X X 



X X 



X X 



X X 
X X 
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X 
X 
X 
X 



Table E-2. lOUUL PUOBT TASK MDDDLB CiTEOOBT (oontlnued) 



m T38 A10 F15 F16 C130 IC135 CUI B52 i? F14 B52 C$ 

OFT OFT OFT VST OFT USr VST OFT VST UTS inS I8S mtm 



1.3S 



Aileron Bolls 

Afterburner Cliiabs 
Air Refueling Bendezvoua 
Air Refueling Traok 
Hadar Traix Departure 
Auto Pilot UtlliZBtion 
Lost Vingoian IFD 
Inflight Refueling 

Maintain Position 

Change Positioo 

Breakaway 
Landings 

Full Stop 

Touch and Go 

Stop and Go 

Assault 
Landing Roll Out 



X X X 



X X 



X X 



X X 



X X X X X X X X X X X X 



X X X 



X X X X X 



X 
X 
X 



X 
X 
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K X X X X X X X X X X 



ERIC 



Tiblf ^2. lOm FUGflT m MODULE CiTEGOn (ooDtlnuod) 



T37 T36 A10 F15 F16 C130 IC135 m B52 A7 H fU 652 C$ 

Tia on OFT on VST on Hsr VST OPT vst ifts afts iss upttfhs 

ComiuDloations 

Clearance XXXXXXX XXXX X X 

Ground X X X X X X X X X X X X X 

Tower X X X X X X X X X X X X X 

Traffic Controller X X X X X X X X X X X X X 
GCI XXX XX 

IPFSquatik X X X 

Navigation ID/Tuning t X X X X X X X X X X X X 

I m Setup .XX XX XX 

XX XX X 



TACAN Update 
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TabU B-3. TACTICAL PfiOCEDDUS TASK HODDLK CATE60KI 

T37 136 AID F15 F16 C130 KC135 CHI W2 A7 Fll FU m C$ 

m OFT OFT OFT HST OFT VST VST OFT H5T AFTS AHS I3S AimmS 

ileapoDS Systea Checks It K X X 

Fence Check ]( I 

Ordnanoe Armitig/Peamlng ][ K XXX 
Electronic Warfare 

Pref light Frooedureo X X I 

iDfligbt Procedures XXX X 

Threat Identifloation XXX X 

Threat Evaluation X X X 

PI 

I* Ur^to-GrouDd 

0 

Radar Poaltlon Update X 



I 

Ground Speed Check X 
Radar Calibration X 
Altitude CalibratloD X 



Heapon Systeio Configuration X XX 

Computer Data Entry X X 

142 Special Weapons Proced. X X 
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Table B»3. TiCTICAl PKOCBDQSKS TiSK MODDLE CiTECOn (oootM) 

T37 T38 AlO F15 F16 C130 K135 m B52 if n PjJi B52 C5 

on ow tCT Ksi on HUT Bsi on ysT ms ins m mtm 

Alr-to-Alr 

Scraoble % i 

iladar Calibration X 

Badar Search X x X 

Hadar Look-on XX X 

iladar Interpretation x X 

Target Sorting X 

Veapon Systen Configuration X X X 



I 
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Table mm fUOBT TASK MDEK CiTEGOBI 

T3r 136 AID F1S F16 CI30 KC135 C141 m A7 F« F14 B52 C5 
TlSt OFT OFT on V3T on VST liSr OFT HST tfTS tfTS ISS ASPHPHS 

Electronic Warfare 

Tactical Eoployisent III t 

Evasive HaneuverlJig X I I i X 

Chaff 0Dd Flares III t 

Defensive Coordination Exercise X 
Drop Zone 

Slov Down X 
Run In X 

n 

H Air Drops X 
Target/Drop Zone Escape X X 

Air-to-Qround 

Lov Level Havlgatlon XX XXX 
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Airspeed Control XX XXX 

Altitude Control XX XXX 

Time Course Corrections XX XXX 

Radar Eoploynent X 

Target Acquisition X , 

Tine Over Target XX XXX 
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T37 T3B A10 P15 

on omr OFT m 



Ueapon Helease Paraaetora 

LaydOHD 

Loft 

LADD 

Strafe 

Veapon Systen Solution 

Badar Bombing 

Badar Offset 

Havigatlon Booblng 
Flgbtor Turn Ilendezvous 
Alr-to-Mr 

Badar Search 

itfldar Look-on 

Target Sorting 

Besponae to GCI 

Geometry Control 

Head-on Intercept 

Fwd Qrt Intercept 
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16 C130 KC135 CM1 B52 A7 Fl Ft4 B>i2 ($ 
OFT m HST OFT HST tfTS AFTS IS3 IHmPHS 

K X X 



[GBT TASK HODDLB CATBQOBI loontloued) 



X X 

X X 
X 

X X 

X X 

X X 

X X 



X X 
X X 
X 

X X 



X 
X 



X 

X 



X 
X 
X 
X 
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Table TICTICAL FUGBT m MODOLB CITE60RI (continued) 



w 
I 



T37 T38 ilO F15 F16 CI30 IC135 0141 m AT F^l m B52 C5 

m OFT OTT OFT VST OFT VST VST OFT VST ms AFTS i ^VS iRFTTPNS 

fieaa Intercept II X 

Stern Conversion X X X 

fli Alt/Hi Spd Target X X 

Search Only Intercept X 

Target Identification X 

HRM Launch I X 

SRM Launch XX X ■ 

Gun Attack X 

X X 
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Table QffiRGEIC! aiGE^ IISL MODOLB CiTEGOlI 



T3T 138 A10 F15 F16 CI30 K135 Ct^l B52 A7 n tU 162 C5 
OFT on OW IfST OFT VSr MSI OFT SST IFTS tfTS ISS AHPTTPHS 



Degraded flight Conditions X X X X X X X X X X X XXX 



Engine Out Approacb 
No Gyro Approach 
Aborted Take Off 



X X X X 



X X X X 



X X X X X X X 



X X 



X 



X X 



X 



Hinlinua Fuel Profile 
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Tablt^. BSBGEICI PfiOCEDDKBS Tia HODQLB aTEGOI!! 



T37 T38 110 F15 F16 C130 KC135 CIQI m if ^ F14 m C5 
TiSK OFT OR OFT VST OFT VST VST OFT VST 1FT8 AFTS ISS UFTTPHS 



lODedlate Aotion Energe&cles t I t t i I t I t a I t X 

System Malfunctions XXXXXXX XX XX XXX 

Ordnance Halfunotlons t 

Abnormal Start X X X X X X X X X X X 

Air Start X X X X X X X X X X X 

Fuel Jettison X X 

External Stores Jettison X X 



pi 
I 
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ISS IMPLEMENTATION CONSIDERATIONS 



ISS IMPLEMENTATION CONSIDERATIONS 



Introduction The purpose of this appendix is to provide technical readers 
with a general understanding of ISS cost and implementation 
considerations. Since technology is advancing rapidly, many 
cost factors are being reduced, and there can be little 
confidence in quantitative predictions of the future. As 
a consequence, the state of the art must be periodically 
investigated to assess issues about the feasibility and 
desirability of specific ISS implementations. With this 
in mind, the appendix attempts to provide a framework for 
documenting those cost and implementation considerations which 
should not be forgotten. 

Organization The organization used in this appendix is derived from high 
and Scope level architectural components identified from previous ISS 

implementations. Each section of this appendix represents a 
major ISS component. What is truly important to an effective 
ISS implementation is the development of a task modules database 
and the sp.ftware which supports it. These components are thus 
presented first. The computer system and statiot^ which support 
the database and software, and allow the user to work with the 
ISS; are included next. Additional components which are necessary 
and unique to ISS implementation are included last; they are 
the simulation Interface . anH the life cvcle cost component. 

Other traditional system development components such as project 
management, data requirements, integration and test, systf>ra 
test and evaluation, and site activation are not specific.) v 
addressed here because ISS -unique consideration;; were minimal! 
However, the components should be included in any final cost 
analysis . 

Format For each component, the discussion includes: 

o Componeng. Name given to the component. 

o Definition. A definition of the component. 

o -Purpose and Int ended Use . What role the component plays 
within the implementation and costing of an ISS. 

o post Factors. General cost factors which should not be 
overlooked are included. In order to produce, rsore precise 
cost estimates, it is reconmiended th&t future procurements 
utilize strictly standardized worrk brt^U?*o\rri rjtruccures 

F-1 
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ISS IMPLEMENTATION CONSIDERATIONS 



with costs reported to levels which address the instructor 
support features so that accurate historical records may 
be preserved. 

o Options and Tradeoffs . Implementation options and tradeoffs 
which may affect the cost and performance of the ISS. 

o Example . Past implementation example based on the F-14 
ISS. It is used throughout this appendix as an example 
of ISS technology because it was designed to provide 
state-of-the-art instructor support functions in the 
areas of monitoring, analysis, debriefing, graphics replay 
and record keeping, in addition to instructor-oriented 
s imulation control. ISPs supported by the ISS include 
the briefing utility, total and partial freeze, scenario 
control, initial conditions , automated and manual 
malfunction control, reposition, automated performance 
measurement , procedures monitoring, lOS display control 
and formatting, hardcopy /printout , remote graphics replay, 
data storage and analysis, and a tutorial. Although the 
F-14 ISS was added on to an existing F-14 OFT, the concepts 
presented in the examples can also be applied to an ISS 
that is procured as part of a new ATD. 

o Lessons Learned . Lessons learned during /from the 
implementation of the four prototype systems. Readers are 
encouraged to submit their own lessons learned to be added 
here . 
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ISS IMPLEMENTATION CONSIDERATIONS 
Task Modules Database 



Component 



Task Modules Database 



Definition 



The task modules database consists of computer files representing 
task modules (see Section IV, ''Providing Operational 
Information") which are used by ISS software to determine the 
logically related series of events that combine to meet the 
criteria of a specific objective. 

For example, if the task module builder defines the task module 
carefully, there should be a one-to-one correlation between 
each training objective and a task module. See Table F-1 for a 
basic chocks -to -chocks scenario relating these two elements. 



Table F-1: 

Partial 

Scenario 



Purpose and 
Intended Use 



TRAINING QBJRCTTVF, TASK MODULE 



TYPE * 



Perform takeoff 
checklist 



Takeoff checklist Normal Procedures 



Take off successfully Takeoff 

Fly appropriate de- Departure 
parture flight path 



Normal Flight 
Normal Flight 



Identify and correct Hydraulics failure Emergency Procedures 
hydraulics malfunc- 
tion 



Fly appropriate ini- Approach 
tial approach vector 



Normal Flight 

Normal Procedures 

Normal Flight 

Normal Procedures 

* See Section IV for an explanation of task module types. 

The task modules represented within the task modules database 
specify what iSF-related functions the software is to perform; 
how, when, and under what conditions the function is to •^be 

F-3 



Perform descent check- Descent checklist 
list 

Fly final approach to Final approach 
ground 

Perform postlanding Postlanding 
checklist checkl is t 
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ISS IMPLEMENTATION CONSIDERATIONS 



performed. For example, a takeoff task module might begin when 
an aircraft exceeds 0 knots and terminates when the aircraft 
achieves a positive rate of climb. Within this task module 
v7ould be appropriate triggers for displays, scenario control, 
and other ISFs. 

From a system resources point of view, the cask modules reduce 
Che amount of data that requires monitoring to encompass only 
those events that are critical at a spc^cif ic point in time . 
For example , during an engine failure at 30,000 feet the 
position of the landing gear is not important; but during an 
approach, the position of the landing gear may be associated 
with a primary training objective. By reducing the monitored 
events, there is more processing time available for ISFs. 

Task modules may be consecutive or concurrent. For example, 
the departure taf?k module may start upon completion of the 
takeoff task module. An emergency procedures (malfunction) 
task module, however, may take place at any appropriate time 
and may overlap both the takeoff and departure task modules. 

In addition to the basic training objectives related task modules 
there can be one other cask module running at all times. In 
past Implementations this has been referred to as an umbrella 
task module. The umbrella can monitor hypercritical events 
that must be associated with the enclre scenario. For example, 
a crash would trigger a diagnostic message and possibly a reset 
if desired from the umbrella task module. 

Pseudo- task modules unrelated to training objectives may 
be used to reposition the aircraft or reset initial flight 
parameters for the instructor's convenience. See Table F-2 for 
a partial task module event chart of a typical scenario. 
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ISS IMPLEMENTATION CONSIDERATIONS 
T^s^ Modul-es Database 



Cose Factors 



The cost of development of the task modules database will 
depend on the number of unique task modules and the number 
of different training event scenarios in the training syllabus. 



Options and 
Tradeoffs 



The cost of developing and maintaining a task modules database 
can be reduced by providing a highly functional database 
editor. This may increase the initial procurement cost of 
software but may result in savings over the life of the system. 



Example 



From a software point of view, the task modules database can be 
iraplemented as several files which contain different types of 
information. Fileo used for the F-14 ISS are listed below: 

o MIciQjn n profile File . This file contains data needed to 
define an entire exercise (mission). It consists of a 
series of records which define the task modules in the 
exercise and the events or conditions which will trigger 
tiie execution of the task modules. When an exercise is 
Initiated, ^' ^'^ file is transferred to memory and Is used 
to centre j t-y," activity of the ISS. 

o £sRO§liisiL..ULe.. This file Is for task modules that 
require a certain location. For example, the takeoff task 
module requires the aircraft to be on a runway to start, 

o Jnltial Conditions File . One file for each task module 
defined in the system. Describes the events and other 
starting conditions that allow the system to determine 
when a task module is to start execution. 

o Events File , One file for each task module defined in 
the system. Describes the events to be detected when that 
task module is running. 

o Sequence File . One file for each task module defined in 
the i>ystem. Describes the relationships of the events to 
each other under a varying number of circumstances and 
provides the information on action to take when the event 
occurs . 

o Perf ortnapge Meas ur e"^ ?^^: Flle > This file contains 
performance parameter data including limits and tolerances 
for each task module. 
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Task Modules Dattahagg 



o Scorin g File . One file for each task module defined in 
the system. Describes the grading criteria that will be 
used when scoring a task module . 

o . DtspT,av File . One file for each Cask nodule defined in 
the system. Contains a list of pictures to be displayed 
when the task module is initiated. 

o Xext File . One file for each task module defined in the 
system Contains descriptive and error text messages to 
be displayed vhen events occur during the execution of a 
task module . 

include^-^^^^ associated with the F-U ISS task modules database 

o Pt^plav Temp late Files. One file for each basic display 
frame defined in the system. Serves as a template to 
locate both the picture on the screen and in the display 

o Ptcture Touch File ..,. One file for each picture defined 
Contains information needed to properly react to the 
operator touching the "select" areas of the screen. 

Pictuire Dj.,p1av T.tst Files . One file for each picture 
C.J 5°"^^^"^ information which describes the picture 
'iisplayed, including the binary data used to generate 
the graphic displays. 



ft^rneH "^"^Jf^ formulation of task modules proved to be costly 

Learned and an editor to aid in generating data files was recommended 



F-7 

162 



ISS IMPLEMENTATION CONSIDERATIONS 
Software 



Component 
Definition 

Purpose and 
Intended Use 



Cost Factors 



Options and 
Tradeoffs 



Software refers to the sequence of instructions and data used 
to direct the computer to perform a desired operation or 
sequence of operations. 



Software is required to develop and run the task modules 
database on the ISS. To develop and build task modules, it is 
essential that an editor be implemented to obtain event and 
procedural data, generate text files , build graphic displays , 
and define parameters for all related ISFs, To run task 
modules two or three primary software modules are required for 
system event detection and monitoring. 

Software modularity is encouraged in that each independent 
ISF can have its own associated software module. For example, 
lOS display control and formatting would be independent of 
automated performance measurement. Such a modular approach 
provides flexibility and ease of execution. Other support 
modules such as a graphics software module may be required to 
provide for actual display device dependent output capabilities. 



The cost associated with this element includes the time required 
to design, write, integrate, and test software. ISS software 
complexity is largely determined by tiie number and types of 
tasks that are to be taught and the instructional features 
which are incorporated in the ISS. The magnitude of software 
development will depend on whether the ATD is intended for part 
task training, operational flight training, single seat weapon 
system trainings or full crew mission training. It will 
also depend on which of the ISFs has been selected and the 
additional considerations which must be taken into account for 
their customized implementation. 



Software modularity allows for functionality in phases. 
During system development, as soon as an ISF is programmed, it 
can be used. Far example, automated performance measurement, 
procedures monitoring, remote graphics replay, and data storage 
and analysis capabilities can be added after an initial delivery 
of lOS display formatting, initial conditions, scenario control, 
malfunction control, freeze, and reposition. A tutorial can be 
a final addition. 
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Software 



Commercially avalL.ble operating systems and utilities can be 
Integrated into the ISS to reduce software development costs 
The commercial products, however, raay require addit?on^l' 
tailoring to be e ffective In the ISS environment 

Example The basic architecture of the F-U ISS utilizes event triggers 

fctlvaL ^ « processing activity. Messages are passed to 
activate responses to the events as defined within the task 
module files (see the Task Modules Database example) . Simulation 
events . "^^^'^^^^ ^"^^ evaluated five times a second to detect 

<^ On - Upe H l^^ori Co Ti dnrr . Mission conduct is the execution 
?CA^?r T . ^""^^^^^^^ in one of three modes of operation 
SSng iS^rT'"' '^'^'^ ^P-i-li"^ Task 

Ing^yuqyor gg^it t o U Receives messages from the 
graphics display module (see below). Controls 
operation of the simulator interface. Controls 
the execution of the task modules. Controls 
repositioning. Updates and maintains environmental 
options. Maintains, updates and formats a list 
of task modules comprising an exercise. Creates and 
terminates applications processes, 

fiony^yt:ey■Pe^R^^or,, Converts cockpit device values 
from the simulator to formats usable by applications 
programs. Detects discrete events associated with 
pilot actions or changes in aircraft parameters. 

£r-opduye? ffon1<?ori. Determines the correctness of 
various cockpit procedures based on a predetermined 
template. Events will checked for legality 
within the current proceduri;,' context and for correct 
order of occurrence. The Procedures Monitor will 
support a s^sparate monitor task for each active task 
module . 

Pgr f QT T n^apc . e MF.93ur em,ft pr^ Samples, processes and 
records aircraft parameters. The measurements are 
divided into two groups: primary- - those used In 
scoring Che flight, and secondary- -those measured and 
recorded for research purposes, 

K&EnaL.. Handles hardware interrupts and transfers 
data from the simulation system. 
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Aircraft Monitor, Maintains displays concerning 
aircraft posicion, key parameters , important instrument 
values, and configuration. 

Controller Model. Generates voice output to emulate 
the following human controllers during execution of 
an exercise : tower , departure , approach, final . 

Scoring. Scores the student's flight and pi.ocedures 
performance for each task module executed. 

Event/Reolav Recorder. Records display data generatec^ 
during run- time by task module executions as wel7 i-^ 
miscellaneous system events. 

o On-line Exercise Setup and Debriefing. Includes logging 
onto the ISS , reviewing student performance prior to 
mission setup, constructing an executable mission (ISEL and 
STT modes), and debriefing the mission after completion. 
Debriefing entails review of ISS assigned grades and 
replay of all or selected task modules from the exercise. 

Exercise Definition. Builds a mission definition file 
to describe an exercise for the ISEL and STT modes, 
or select from a list of predefined CANNED missions, 
and conducts mission briefing functions for all three 
modes. 

Logon - Student Performance Review. Controls access 
to the ISS and conducts an interactive review session 
of previous student performance. 

Debrl ef ing , Permits the instructor to review a 
particular training session, approve /modify grades 
given by the ISS, and replay portions of the exercise. 

o OTv line Graphics DisDlav. Controls the graphics chores 
during all on- line ISS operations. 

o Of ^- line Support s Programs that are intended to be run in 
the off-line m^i^ . Includes introduction of predefined 
task modules into ISS by the generation of the required 
control and data structures, analysis of data recorded in 
the daily audit file, maintenance of student record files 
and system software, and functional integrity verification 
of the ISS prior to on-line operations. 
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Procedure Definition, Translates procedural 
descriptions Into the control structures required to 
execute a given task module (see the previous 
component discussion on the Task Modules Database). 
The tables so generated will drive logics for 
procedures monitoring, event detection, and performance 
measurement . 

Ev ent S t ream Anal ysis^ Data recorded by the Event 
Recorder task In the Applications Processor will be 
used to provide ISS usage data, program debugging 
aids, and operating environment data for research 
purposes . 

Hou^e^geplng, Disk file maintenance and changes in 
user access lists. 

■Co Jf Idencfi .,_te s t ^ Checks functional integrity of the 
ISS prior to initialization of on-line operations. 



Lessons The manual formulation of task modules proved to be costly and 

Learned an editor to aid in generating data files was recommended 

Languages and simpie editors are often difficult and tedious to 
use. A menu-driven, nonprogrammer oriented program to allow 
operational users to define their requirements could be easier 
to use. Although it may be more costly to implement initially 
the cost savings may be realized through use during the life of 
che ISS. 

Synchronous execution of software, can cause problems in detecting 
events for an ISS, For example, a 200 millisecond cycle was 
found to be Insufficient for monitoring momentary switches and 
a 50 millisecond cycle was recommended to account for the 
momentary switch. An ISS can be implemented on an asynchronous 
basis, as accomplished by the F-14 ISS and ARPTT-ISS, to 
account for critical events as they occur. 
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ISS IMPLEMENTATION CONSIDERATIONS 
ConiPVAter System 



Component 
Definition 



Computer System 



The computer system performs all logical and numerical process J ng 
for the ISS. It usually consists of a processor or processors, 
storage, and input/output channels. 



Purpose and The computer system provides the means for adding instructional 
Intended Use support to a simvilator capability by executing software which 
permit monitor! ^ simulator variables » instructor controls, 
student actions, and making the instructional responses desired 
of the ISS. The types of ISFs which may be implemented in this 
way aire listed earlier in this document. If the ISS computer 
system did not exist, these features either would be impossible 
with the basic simulation facility or, in some cases, would be 
only by manual Instructor action. 



Cost Factors Programs which execute within the computational system require 
adequate processing capacity, main memory and mass storage. ^ A 
thorough analysis of system functional requirements, with 
provis ions for growth , is required for estimation of these 
parameters . 

o fyocjtesslng capacity. The processing capacity of a computer 
takes into account the number of instructions which can be 
executed per second and the rate at which input/output 
information can be transferred. The latter is also a 
function of the devices added to the system, such as mass 
storage devices. 

o M^f- P i?iemorv. Main memory size is usually expressed in 
terms of the total number of bytes which may be stored. 
Fast processing is normally accomplished with information 
in main memory. 

o ^ass storage^ Primary mtiss storage is used for storage of 
programs and data that are necessary for daily use of the 
ISS and for short term storage of data collected for a 
training event. Secondary mass storage is used to form an 
archive of programs and data that are not required for 
daily use of the ISS. Primary mass storage might emphasize 
fast access to a disk system whereas secondary storage 
could be relegated to slow devices such as tape drives. 
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Contributions to the storage requirement by each ISF 
should be estimated using the stated functional requirement 
and the expected utilization. For example, the storage 
requirements for Simulator Record/Replay are large and 
need to accommodate the total number of minutes which are 
to be recorded (see the Simulator Record/Replay ISF) . 

Function complexity, that is degree of interaction among ISFs 
and task module concurrency requirements, may affect the cost 
of Implementation of the basic ISS software architecture and 
dictate the computer system capacity and storage requirements. 

Expected system performance also determines the computer system 
cost. For example, display update rates of 1 to 2 times a 
second are sufficient for ISS implementations. Displays need 
not be updated if the display content need not be altered. 
Given these performance requirements the ISS could be implemented 
using less costly computer systems. If performance requirements 
requiring higher update rates were unnecessarily Imposed, the 
cost would Increase. 

Options and Processing may be distributed amona, lass costly, less capable 
Tradeoffs computer systems rather than one costly centralized system. 

Tradeoffs would be experienced in the computer- to -computer 

Interface cost. 

Oftentimes a tradeoff exists between the hardware and software 
costs. For example, lots of programmer time can be wasted 
trying to scale down program sizes to fit Into limited main 
memory. As memory costs have decreased and programmer labor 
costs increased, purchase of additional memory can realize cost 
savings . 

Example The F-14 ISS utilized two computer systems. One was dedicated 

to On-line Graphics Display (see example for the Software 
component) and the other performed all other processing tasks. 

o Applicfitions Computer System 

Data General Eclipse S-250 

(1.23 million instinxctions per second) 

1024 KB main memory 

96 MB disk storage 

1/2 inch magnetic tape drive 
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Computer System 



o Display Computer System 

Data General Eclipse S-130 

(1.23 million instructions per second) 

384 KB main memory 

10 m disk storage 



Lessons Large program sizes may cause system response to be too slov. 

Learned This can be alleviated by tuning the operating system, adding 

more memory, and reorganizing files on mass storage to optimize 

data file access. 

The processing speed of the selected computer may affect the 
Simulator- ISS interface. For example, data may have to be 
buffered from the interface in order to allow time for 
processing. 
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Stations 



Component Stations 



Definition Stations provide a person- machine interface between all users 
of the ISS and the ISS. Components of the station include 
input devices, such as keyboards and touch panels, and output 
devices, such as hardcopy printers, speech genaration equipment, 
and graphic and tabular displays. 



Purpose and Stations can be used for: 
Intended Use 

o ISS and simulation system :i?ri;rol 

o Monitoring of student activtcy vhile training 

o Display of student activity after training 

o Retrieval of performance information 

o Prep«:'.acion of a preprogrammed mission scenario 

o Update of the task modules database 

o Maintenance of the ISS 



Devices located at the station, the number of stations, and the 
location of the stations are factors which affect their cost. 

o Station device s . ^ The intended station functions 
will determine the devices located at the station. 
Identification of functions requires an analysis of user 
tasks . 



tJuipbey of .. stations . ^ Candidate stations include on-board 
(in cockpit), off -board (outside cockpit), dedicated 
briefing/debriefing (see the Briefing Utilities and Remote 
Graphics Replay ISFs), mission-generation, training 
objective database generation, and programmer/maincenance 
stations . 



I,o . 9^tl,ot^ of stat^on^ Cost may be influenced by the 
location of a station and on any constraints on the 
size of the components. Replacement of an existing 
operator console may also bfe a cost factor. 



Options and The number of stations, locations, functions to be performed 
Tradeoffs concurrent operation, information displayed, control actions, 

specific control/displays, and human engineering design! 
present a multitude of options to be considered for ISS 
stations. An analysis of training functions, training load, 
personnel characteristics, and specific training constraints 
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Stations 



Example 



Lessons 
Learned 



will be required to identify specific options to be considered 
for tradeoff study. 

The functionality, maintainability, reliability, and cost of 
currently available devices should be surveyed to arrive at 
cost estimates. State of current commerci.al offerings should 
be considered to keep costs at reasonable levels. For example, 
1985 technology offers color, raster graphics d >lays with 
antialiasing features (to minimize stairstepping). 

An important input device consideration is that a single input 
method be adopted at each station so as not to confuse the 
user . 



Two similar instructor stations were used on the F-IA ISS. The 
Primary ISS Station was placed next to the existing Instructor 
Operat : Station (ICS); the Remote Station was used for secup, 
brief Jebrief and gradirsg. Each consisted of upper and lower 
graphic displays with a touch pad on the lower for operator 
control Inputs . A separate printer/plotter was used for 
hardcopy needs . Additionally, the sys tt^m included voice 
generacion capabilities for controller models, and two 
maintenance terminals. 

Mote that future ISS implementations should incorporate ISS 
station requirements into main and remote ICS requirements, 
striving towards an ISS that is fully integrated into the ATD. 



The touch panel design hf^ received good user acceptance, 
requires no special input skills, and allows only legal inputs 
to be tnade. Touch panel technology has been found to be 
reliable for ISS use. 

Display resolutions of 512 x 512 picture elements and 16 colors 
have been found to be sufficient for symbolic information. 
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Component 



Slraulaclon System Interface 



Definition 



The simulation system interface is that portion of the system 
which allows the ISS to transmit to, and receive data from, the 
rest of the ATD. 



Purpose and 
Intended Use 



The simulation system interface allows the ISS to communicate 
with the remainder of the ATD to: 



o 
o 
o 



initiate control of the simulation scenario 

monitor flight variables, such as altitude and airspeed 

monitor discrete actions, such as switch actions 



Cost Factors 



The simulator interface can be a major hardware cost when the 
ISS is to be added to an existing simulator capability. There 
Is a major engineering challenge to find a least costly way to 
obtain needed data and exercise required control. The solution 
varies on a case -by-case basis since It depends on how the ATD 
Is built. Lower cost can be expected If the ISS can be designed 
as an Integral part of a new ATD acquisition. 



Options and 
Tradeoffs 



The following are alternative methods for the simulator 
Interface. Only the first two methods have been used In the 
four prototype systems as additions to existing ATDs . 

° Pa^a AQquls,ltion Svstem/Svitch Up|r. This type of interface 
Interrupts the data path(s) between the central processing 
unit (CPU) of the ATD and the hardware device which 
distributes CPU outputs to the flight station, visual 
system, motion system, and operator/ ins true tor station, 
and funnels Inputs from these sys terns to the CPU . The 
Interface therefore allows communication with the ISS CPU 
and acquires data traveling in either direction at che 
ATD, totally transparent to the simulation system. 

o gh^yed m^niPrz^ a portion of the ATD CPU memory can be 
shared with the ISS CPU. The shared memory would contain 
all data originated by the operator/lnstrructor and all 
peirtlnent ATD flight information. 

o Sonventlonal da^^ U^Ki A possible alternative is the use 
of a high speed data link which connects the simulation 
system computer(s) and the ISS computer(s). Both systems 
must have software which handles the required communications 
protocols. 
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Simulation System Interface 



Example To assist the Instructor In training, the F-14 ISS had to 

monitor all information transmitted betw^Gn the Sigma 5 simulator 
system computer and the Instructor Console-Cockpit. All of this 
information passes over a channel between the Sigma 5 main 
memory and an Input/Output Processor, A Data Acquisition 
System/Switch Unit was constructed for placement in this 
channel. In addition to monitoring the information on this 
channel, it was also necessary to alter some of the information 
coming from the Instructor Console to allow the ISS to generate 
sequences of 1; outs which would otheirwise require the Instructor 
to press buttons and turn knobs. This required detecting data 
before data is transferred, and making changes at the time of 
transfer. Finally, the Data Acquisition System/Switch Unit had 
to be able to read information from the Sigma 5 memory to 
provide the ISS computer with Information on the configuration 
of the trainer and the flight situation. 



If an ISS is added to an existing ATD, the simulation system 
Interface involves risks and possible interference with the 
operation of the ATD. The risks can be minimized if the ISS is 
designed into the initial procurement of an ATD. 



Lessons 
Learned 
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Component 



Definition 



Purpose and 
Intended Use 



Options and 
Tradeoffs 



Life Cycle Cost 



Life cycle costs are incurred over the operational life of the 
ISS. Of primary Importance to an Instructor Support System are 
those personnel considerations which affect operator/instructor 
performance in the use of the ISS. Included are considerations 
of the number and type of personnel required to use the ISS, 
QpejfttJrPt?.a.li dggU^. effective instructional use, and training 
for the new or infrequent operator/instructor. 



The ISS must be usable by the specified personnel and allow 
maximum instructional effectiveness. This, in turn, requires 
that the ISS be designed for the number and characteristics 
of operating personnel; the system must be designed for easy 
use and support the instructional process without burdening 
the Instructor; and, training must be provided so that the 
operator/instructors can effectively use the instructional 
features of the ISS, 



Personnel, design, and personnel training aids are among the 
options and tradeoffs to consider: 

o gex^onnglo. The number of people required for instruction 
will depend on the ATD configuration and the design of 
the ISS. The number of people will depend on whether 
instructors are required inside the cockpit as well as 
outside and whether an operator will be assigned for the 
duties of simulator operation and communications. If 
desired, the ISS can include features to simplify simulator 
operation and automate functions which can eliminate the 
need for a separate Operator, and a:1 nimize the burden on 
the Instructor, including the burden of coordinating with 
a separate Operator. People are also needed for maintenance 
and update/revision of the ISS, especially those needed for 
courseware update/revision (e.g., task module creation and 
navigational display definition). The number of people 
associated with the ISS are major factors in determining 
total life -cycle costs. 

For example, in the ARPTT ISS procurement it was shown 
that the ISS eliminates a console operator. Cost savings 
are expected over the 15 year life of the ISS. 
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o ISS Deste^n. The design process consists of the following 
steps: 

Functional Analysis : Definition of the specific 
functions to be performed by the ISS, that is, vl)at 
the ISS is to do. 

Operational Design: Definition of the controls, 
displays, and procedures to perform each of the 
required functions, that is, ]\ow the ISS is to be used 

System Design: Definition of the hardware and 
software to be used in constructing the ISS. 

Of particular interest at this point is the second step, 
that of operational design. Many options and tradeoffs 
are identified at this stage which will ultimately determine 
how well the ISS can be used for instruction by those who 
must use it. It is recommended that representatives of the 
users become actively involved in the operational design 
process. Note that human engineering of the ISS can reduce 
us e r workload and special knowledge/skill requirements , 
and in turn increase training effectiveness while reducing 
life-cycle costs. 

o Ty^lntng, Helps > and Documet^tation . An ATD may be used In 
some curricula by instructors who infrequently use the 
simulator as an adjunct to inflight training and they may 
need some training and help in using the ISS/ATD each 
session. An instructor new to tha ISS/ATD will require 
training in use of the system and the expertise of the 
former instructor may depart with him. One way of coping 
with these situations is to incorporate training features 
in the ISS. See the discussion on the Tutorial ISF for 
suggested training features. 

System documentation can also be provided as a database 
which can be selectively retrieved when detailed reference 
material is needed. 



Example While the optimum operational design used for one system may 

r»ct be best for another, the Instructor- ISS interface used in 
th^ F-14 ISb' (and the ARPTT) may be broadly applicable. The 
ba^ic interface is a CRT with a touch panel and control is 
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exercised through a sequence of menu selections. lai:. \,^n 
several Inherent advantages: 

o the available control options at any given time are 
displayed on the display screen; the Instructor does not 
have to remember specific commands. 

o Only legal options can be selected; there Is no need for 
error checking or the display of cryptic error messages. 

o because of the touch panel, no special Input devices or 
skills are required; one only needs to point at the 
selected menu Item on the display screen, 

o built-in "helps" are easily implemented. 

Such systems In the field have met with good user acceptance. 



Difficulties were encountered with the C-5A PMS when those 
trained in Its use were rotated to nev duties; understandably, 
the PMS option was not used by those who did not know how to 
use it. It is common experience that systems are not effective 
when users are not adequately trained in its use, or if system 
design has not been accomplished with the requirements of the 
using personnel in mind. 



Lessons 
Learned 
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SAMI'I.i; TASK MODULES 



Samples of the two basic task module cypes (flight and procedural) are given 
in this appendix. The tacan approach uask module is a normal flight task 
module. The engine start task module is a normal procedures task module A 
review of Section IV. "Providing Operational Information", is recommended 
before reading these samples. 

The samples are taken from the F-U ISS. An ISS requires certain information 
to be able to provide Instructor Support Features (ISFs) . These task modules 
provi.^e r.hc operational information required for the F-U ISS to support 
the following features: 



o lOS Display Control and Formatting 

o Procedures Monitoring 

o Automated Performance Measurement 



Although beyond the scope of these guidelines, information for an automated 
voice controller is also included. 
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NORKAL FLIGHT TASK MODULE 



TYPE: 
NAME: 

DESCRIPTION: 
START CONDITIONS: 

STOP CONDITIONS: 
RELATED ISFs: 

TASK MODULE SCORING: 



NORMAL FLIGHT TASK MODULE (TACAN APPROACH) 

HI-TACAN ONE APPROACH TO RUNWAY 24 R/L AT MIRAMAR 

STRAIGHT IN APPROACH ON THE 068R STARTING AT 16K FT 

WITHIN 5 MI OF THE lAF 068R 26 DME (TAC 33) AND ALTITUDE 
GT 14,500 FT. 

CPA 068 RAD 1.7 MI (TAC 33) 

lOS DISPLAY CONTROL AND FORMATTING, AUTOMATED PERFORMANCE 
MEASUREMENT, INITIAL CONDITIONS, AND REPOSITION. 





STEP 


WEIGHT FACTOR 


1. 


CROSS lAP 


5 


2. 


ALT AT lAF 


5 


3. 


HDG AT PUSH OVER 


5 


A. 


AIR SPD AT lAF 


5 


5, 


APPROACH AIR SPD 


15 


6. 


INBOUND TRACK 


15 


7. 


ALT AT 22 NM 


5 


8. 


ALT AT 14 NM 


5 


9. 


ALT AT 13 NM 


5 


10. 


ALT AT 6 NM 


5 


11. 


FINAL APP AIR SPD 


15 


12. 


ALT AT 3.3. NM 


5 


13. 


ALT AT 1.7 NM 


10 






TOTAL 100 



STEP NO. 1 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



CROSS "FEEGA" lAF 

CPA 068 Ri>J) 26 DME (TAC 33) 

N/A 

AUTOMATED PERFORhlM'CE MEASUREMENT 
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DIAGNOSTICS : 

DISCREPANCY: NM FROM "FEEGA" GREATER THAN 2 MI 
ERROR: POOR NAV CONTROL 

RULE: CROSS "FEEGA" 068/26 FROM TAG 33 

DISCREPANCY: FREQ NOT EQUAL 281.8 
ERROR: WRONG UHF FREQUENCY 

RULE: SD APP - 161. i 

AUTO VOICE: 

CONTROLLER: MEGO APPROACH / FRE'^ - 281.8 

' Y ZERO ONE CLEARED FOR TACAN APPROACH TO RUNWAY 
TWO FOUR EIGHT CALL WHEN LEAVING ONE SIX THOUSAND 
FEET" 

MEASUREMENT PACKET: 

CPA 068R 26 NM / TYPE - SNAPSHOT / OPTIMUM - 0 

SCORING: 

SCORE 4.0 3.5 3.0 2.5 2.8 

MEASURE <.5 <.75 <1.0 <2.0 ->2.0 



STEP NO. 2 

DESCRIPTION: 

START CONDITIONS 

STOP CONDITIONS: 

iSFs and RELATED 
INFORMATION: 



CROSS "PEEGA" NO LESS THAN 16,000 FT. 

CPA 068 RAD 26 MI (TAG 33) 

N/A 



AUTOMATED PERFORMANCE MEASUREMENT. 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 



ALTITUDE LESS THAN 15,500 FT. 
POOR ALT CONTROL 

CROSS-FEEGA" 068/26 AT 16,000 FT. OR GREATER 
N/A 



MEASUREMENT PACKET: 

ALTITUDE / TYPE - SNAPSHOT / OPTIifUM - IS.OQO FT. 



SCORING : 
SCORE 



4.0 



3.5 



MEASURE <16 , 500 
>15,950 



3.0 

<16 , 750 
>15 , 900 



2.5 

<16.850 
>15,850 



2.0 

<17,000 

>15,250 -<15,250 
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STEP NO. 3 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



START DESCENT WITHIN 45 DEG OF APPROACH HEADING 

VSI GT 3000 FPM, ALT. LT 15,000 FT Al^D DME DECREASING 

N/A 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

kULE: 

AUTO VOICE: 



HDG LT203 OR GT 293 
POOR NAV CONTROL 

START APP WITHIN 45 DEG OF INBOUND HDG. 
N/A 



MEASUREMENT PACKET: 

HEADING / TYPE - SNAPSHOT / OPTIMUM - 248 



SCORING: 
SCORE 



4,0 



MEASURE >203 
<293E 



3.5 

>198 
<:298 



3.0 

>193 
<303 



2.5 

i»193 
<308 



2.0 

-<193 
->308 



STEP NO. 4 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and REUTED 
INFORMATION: 



CROSS "FEF?A" lAP AT 250 KIAS 
CPA 068 RAD 26 MI (TAC 33) 
N/A 

AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

RUl.fi: 

AUTO VOICE: 



KIAS GT 265 OR LT 235 

POOR AIR SPD CONTROL 

CROSS "FEEGA" 068/26 AT 250 KIAS 

N/A 



MEASUREMENT PACKET: 

AIRSPEED TYPE - SNAPSHOT / OPTIMUM - 250 KIAS 
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SCORING: 
SCORE 

MEASURE 



4.0 

<255 
>245 



3.5 

<260 
>240 



3.0 

<:265 
>235 



2.5 

<270 
>230 



2.0 



STEP NO. 5 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



MAINTAIN APPROACH AIRSPEED 250 PRIOR TO IJVNDING CHK. LIST 
"PEEGA" 068R 26 MI (TAG 33) 
LANDING GEAR HANDLE DOWN 



AUTOMATED PERFORMANCE MrASUREMENT 



DIAGNOSTICS: 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 



KIAS GT 265 OR LT 235 

POOR AIR SPD CONTROL 

MAINTAIN 250 KIAS DURING APPROACH 

N/A 



MEASUREMENT PACKET: 

AIRSPEED TYPE - RMS / OPTIMUM - 250 KlAS 



SCORING : 
SCORE 

MEASURE 



4,0 

<255 
>245 



3,5 

<260 
>240 



3.0 

<265 
>235 



2.5 

<270 
>200 



2.0 



-<28 



STEP NO. 6 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



TRACK INBOUND ON 068R 

CPA "FEEGA" 068R 26 MI (TAG 33) 

CPA 068R 1.7 DME (TAG 33) 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 



RAD GT 073 OR LT 063 
POOR NAV CONTROL 
TRAGIC INBOUND 06 8 R 

N/A 
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MEASUREMENT PACKET: 

RADIAL / TYPE - RMS / OPTIMOM - 068 



SCORING: 



SCORE 


4.0 


3.5 


3,0 


2.5 


2.0 


MEASURE 


<70 




<73 


<:83 


«>83 




>66 


>63 




>53 


-<53 



STEP NO. 7 

DESCRIPTION: 

START CONDITIONi*. : 

STOP CONDITIONS: 

ISFs and REUTED 
INFORMATION: 



5,200 ALTITUDE RESTRICTION Al" 22 DME 

CPA 068 RAD 22 NM (TAG 33) 

N/A 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS: 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 



ALTITUDE LESS THAN 5,000 FT 
POOR ALT CONTROL 

CROSS 22 DME AT OR ABOVE 5,200 FT 
N/A 



MEASUREMENT PACKET: 

ALTITUDE / TYPE - SNAPSHOT / OPTIMUM - 5.200 FT 



SCORING: 
SCORE 



4.0 



3.5 



3.0 



MEASURE <5,700 
>5,200 



<6,000 
>5,150 



2.5 

<6,300 
>5,000 



<6,600 
>5,000 



STEP NO. 8 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and REIATED 
INFORMATION: 



4,700 FT ALTITUDE RESTRICTION AT 14 DME 

CPA 068 RAD 14 NM (TAG 33) 

N/A 

AUTOMATED PERFORMANCE MEASUREMENT 
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DIAGNOSTICS : 

DISCREPANCY: ALTITUDE LESS THAN 4,500 FT. 

ERROR: POOR ALT CONTROL 

RULE: CROSS U DME AT 4,700 FT OR GREATER 



AUTO VOICE: 



N/A 



MEASUREMENT PACKET: 

ALTITUDE / TYPE - SNAPSHOT / OPTIMUM - 4,700 FT 



SCORING : 
SCORE 



4.0 



3.5 



3.0 



MEASURE <5 , 000 
>4,650 



<5 , 300 
>4,550 



2.5 

<5,600 
>4,450 



2.0 

<5,9O0 
>4,400 



-<4 , 400 



STEP NO. 9 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



4,400 FT ALTITUDE RESTRICTION AT 13 DME 

CPA 068 R X3 NM (TAG 33) 

N/A 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 



ALTITUDE LESS THAN 4,200 FT. 
POOR ALT CONTROL 

CROSS 13 DME AT 4,400 FT OR A30VE 
N/A 



MEASUREMENT PACKET: 

ALTITUDE / TYPE - SNAPSHOT / OPTIMUM - 4,400 FT. 



SCORING : 
SCORE 



4.0 



3.0 



MEASURE <4,70O 
>4, 350 



<5 , 000 
>4,300 



2.5 

<5,300 
>4,250O 



2.0 

<5,600 
>4,200 



-<4,200 



STEP NO. 10 
DESCRT'^iON: 
START CONDITIONS; 
STOP CONDITIONS: 



2,300 FT ALTITUDE RESTRICTION AT 6 DME 

CPA 068 RAD 6 MI (TAG 33) 

N/A 
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ISFs and RELATED 

INFORMATION: AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS: 

DISCREPANCY: ALTITUDE LESS THAN 2,100 FT. 

ERROR: POOR ALT CONTROL 

RULE: CROSS 6 DME AT 2,300 FT OR ABOVE 

AUTO VOICE: N/A 

MFASUREMENT PACKET: 

ALTITUDE TYPE - SNAPSHOT / OPTIMUM - 2,300 FT. 

SCORING : 

SCORE 4.0 3.5 3.0 2.5 2.0 

MEASURE <2,500 <2,750 <3,OO0 <3 , 300 

>2,250 >2,20O >2,150 >2,100 -<2,100 



STEP NO. 11 
DESCRIPTION: 

START CONDITIONS: 
STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



^-iINTAIN FINAL APPROACH AOA WHEN IN LANDING CONFIGURATION 
14.5 UNITS 

WHSN GEAR AND FLAPS DOWN 
CPA 068R 1.7 NM (TAG 33) 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS ; 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 



IF AOA GT L? OR LT II 
POOR AIR SPD CONTROL 

MAINTAIN FINAL APPROACH AOA WHEN ON FINAL 
N/A 



MEASUREMENT PACKET: 

AIRSPEED / TYPE - RMS / OPTIMUM - 14.5 liwXTS 



SCORING : 
SCORE 

MEASUR-' 



4.0 

<:15.0 
>14.0 



3.5 



3.0 



2.5 



<15.5 
>13.5 



<16.0 
>13.0 



2.0 

<I7.0 
>I2.5 



-^7.0 
-<12.5 



G.8 



ERIC 



1S4 



STEP NO. 12 



DESCRIPTION: 

START CONDITIONS 

STOP CONDITIONS: 

ISFs and IIEIATED 
INFORMATION: 



1,2A0 FT ALTITUDE RESTRICTION AT 3.3 DME 

CPA 068 RAD 3 . 3 NH (TAC 33) 

N/A 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS: 

DISCREPANCY; 

ERROR: 

RULE: 

AUTO VOICE: 



ALTITUDE LESS THAN 1,200 FT. 
POOR ALT CONTROL 

CROSS 3.3 DME AT 1,240 FT OR ABOVE 
N/A 



MEASUREMENT PACKET: 

ALTITUDE / TYPE - SNAPSHOT / OPTIMUM - 1,240 FT. 



SCORING: 
SCORE 

MEASURE 



4.0 

<1,340 
>1,230 



3.5 



3.0 



2.5 



<l , 440 
>1,220 



<:l,540 
>1,210 



2.0 

<1,648 
>1,200 



STEP NO. 13 

DESCRIPTION: 

START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



860 FT ALTITUDE RESTRICTION AT 1.7 DME 

CPA 068 RAD 1.7 NM (TAC 33) 

N/A 

AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

RULE: 

AUTO VOICE: 

MEASUREMENT iV,'"'" 
ALTITv-C'J ; 



ALTITUDE LESS THAN 840 FT 
POOR ALT CONTROL 

CROSS 1.7 DME AT 840 FT OR ABOVE 
N/A 



.ii - SNAPSHOT /' OPTIMUM - 840 FT 



-<:l,20O 
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SCORING: 
SCORE 



4.0 



MEASURE OAO 
>830 



3.5 

<1,040 
>820 



3.0 



2.5 



<1,148 
>818 



2.0 

<L,2A0 
>800 



-<800 



STEP NO. lA 

DESCRIPTION: 

START CONDITIONS; 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION: 



MISSED APPROACH POINT 

CPA 068 RAD 1.7 DME (TaC 33) 

N/A 



AUTOMATED PERFORMANCE MEASUREMENT 



DIAGNOSTICS : 

DISCREPANCY: 

ERROR: 

RULE: 



IF CPA > .5 
POOR NAV CONTROL 

MISSED APPROACH POINT - 068 RAD 1.7 DME 



AUTO VOICE: N/A 
MEASUREMENT PACKET: 
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NORMAL PROCEDURES TASK MODULE 



TYPE: 
NAME: 

DESCRIPTION: 
START CONDITIONS: 

STOP CONDITIONS: 

ISFs and RELATED 
INFORMATION : 

TASK MODULE SCORING: 



NORMAL PROCEDURES TASK MODULE 
ENGINES START 

NORMAL GROUND START OF BOTH ENGINES 

COMPLETION OF THE PRE- START TASK MODULE, OR EXTERNAL AIR 
ON. 

EXTERNAL AIR DISCONITECTED +30 SEC. 

PROCEDURES MONITORING 
4.0 



CRITICAL iiRRORS 

SEQUENCE ERRORS 0 

%MANDATORy COMPLETE 95 

^OPTIONAL COMPLETE 100 

TIME TO FIRST EVENT (sec) 6 



TOTAL TIME (sec) 



60 



3.5 


3.0 


2.5 


2.0 


WT 


2 


4 


6 


8 


30 


90 


80 


70 


60 


AO 


97 


95 


90 


80 


10 


10 


15 


25 


30 


10 


90 


120 


2A0 


360 


10 



STEP NO. 1 

DESCRIPTION: CRANK LEFT ENGINE TO BUILD UP AUXILIARY BRAKE PRESSURE 

CONTINGENCIES : EXTERNAL AIR AND EXTERNAL POWER ON 

EVENTS: 1. ENGINE CRANK SWITCH - LEFT 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) ENGINE CRANK LEFT" 

PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: IF CRANK SW - RIGHT 

ERROR: CRANK SVT - SWITCH POSITION ERROR 

RULE: CRANK L ENG. TO BUILD AUX. BK. PRESS. 
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MEASUREMENT : 

EVENT 1 - MANDATORY 
SEQUENCE - N/A 

TIME: START FOR TOTAL PROCEDURE 



STEP NO. 2 

DESCRIPTION: POSITION CRANK SWITCH TO OFF AFTER BRAKE PRESSURE HAS BUILT 

UP TO SAFE 

CONTINGENCIES: ENG CRANK - LEFT 

EVENTS: 2. AUX BRAKE PRESSURE SAFE 

3. ENGINE CRANK SWITCH OFF 

ISFs and RELATED INFORMATION: 

I OS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) ENGINE CRWIK OFF" 

PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: IF 3 < 2 

ERROR: AUX BRAKE PRESS UNSAFE 

RULE: CRANK PORT ENG. TO BUILD AUX. BRAKE PRESSURE TO 

SAFE 

MEASUREMENT : 

EVENT 3 - MANDATORY 
SEQUENCE - 2,3 
TIME: N/A 



STEP NO. 3 
DESCRIPTION: 

CONTINGENCIES: 
EVENTS: 



EMERGENCY HYDRAULIC CHECK AND VERIFY CONTROL OF FLIGHT 
CONTROL SURFACES 

EXT. AIR & POWER/EMERG FLT HYD SW - AUTO (LOW) 

4. EMERG FLIGHT HYD. SWITCH - LOW 

5. STICK DEFLECTION - FORE/AFT LEFT/RIGHT 

6. RUDDER - LEFT, RIGHT 

7. EMERG FLIGHT HYD. SWITCH - HI 

8. STICK DEFLECTION - FORE/AFT LEFT/RIGHT 

9. RUDDER - LEFT, RIGHT 

10. EMERG FLIGHT HYD - SWITCH AUTO (LOW) 
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ISFs and RELATED INFORMATION: 



lOS DISPUY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) EMERG. FLT. HYD. SW LOW/HI /AUTO 
PROCEDURES MONITORING 

DIAGNOSTICS: 
IF 9<7<A 

ERROR: IMPROPER CHECK OF EMER. FLT HYD. 
RULE: SWITCH ERROR (SW. - LOW/HI/AUTO) 

DIAGNOSTICS: 

IF 5, 6, 8 OR 9 DO NOT OCCUR 
ERROR: NO CONTROL MOVEMENT 
RULE: MUST CHK FLT CONTROLS 

MEASUREMENT 

EVENTS 4, 5. 6, 7. 8, 9. 10 MANDATORY 
SEQUENCE - 4, 5. 6, 7, 8. 9, 10 
TIME : N/A 
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STEP NO. 4 

DESCRIPTION: ENGINE CRANK TO RIGHT ENGINE FOR START 

CONTINGENCIES: STEP 1 & 2 COMPLETE 

EVENTS: 10. ENGINE CRANK - RIGHT 

ISFs and REUTED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPUY UPDATE: "(TIME) ENGINE CRANK RIGHT" 

PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: IF ENG. CRANK - LEFT 

ERROR: ENG. CRANK (POSITION) 

RULE: START RIGHT ENG. FIRST 

MEASUREMENT: 

EVENT 9 - MANDATORY 
SEQUENCE - 9,10 
TIME N/A 



STEP NO. 5 

DESCRIPTION: RIGHT THROTTLE IDLE AT 20% FOR IGNITION 

CONTIKGENCIES: STEP 4 COMPLETE 

EVENTS: 



11. 


R RPM - >20% 




12. 


RIGHT THROTTLE - 


IDL£ 


13. 


ENG. CRANK - OFF 




14. 


R RPM - 50% 




15. 


R OVSP/VALVE LT - 


OUT 


16. 


RT GEN LT - OUT 




17. 


R FUEL PRESS LT - 


OUT 


18. 


R TIT < 750 





ISFs and RELATED INFORMATION: 

ICS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: EVENTS 12, 13, 15, 16, 17 
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PROCEDURES MONITORING 



DIAGNOSTICS: 

DISCREPANCY - EVENT 12 < 11 

ERROR: R THROTTLE IDLE BEFORE RPM Z2\ 

RULE: R THROTTLE IDLE AFTER RPM - 22% 

DISCREPANCY: R TIT > 750 
ERROR: R TIT - (VALUE) 

RULE: MAX START TEMP - 750 

MEASUREMENT: 

EVENT 12 - MANDATORY 
EVENT 18 - CRITICAL 
CRITICAL SEQUENCE - H, 12 
CRITICAL SEQUENCE - 13, 14 
TIME: N/A 



•iEP NO. 6 
DESCRIPTION:' 
CONTINGENCIES: 
EVENTS: 



IDLE ENGINE INSTRUMENTS CHECK 
RIGHT THROTTLE - IDLE 



19, 

20. 

21 

22. 

23. 



RPM - 63% - 74% 
TIT - 600 +/- 150 
F/F - 1000 +/- 200 
mZ7lE - 5 

FLT HYD. - 3000 +/- 175 



ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: ONLY FOR DIAGNOSTICS 
PROCEDURES MONITORING 
DIAGNOSTICS: 

DISCREPANCY: IF 19 THROUGH 23 NOT WITHIN RANGE THEN- 
ERROR: - (VALUE) COCKPIT DEVICE (NAME) - (VALUE) 
RULE; (DEVICE NAME) (RANGE) NORMAL 

MEASUREMENT: 

EVENT: N/A 
SEQUENCE: N/A 
TIME: N/A 
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STEP NO. 7 

DESCRIPTION: DISCONNECT EXTERNAL POWER 

CONTINGENCIES: RIGHT RPM 63% - 74% (RIGHT ENG. STARTED) 

EVENTS: 24. EXTERNAL PWR - DISCONNECT 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) EXT. PWR. DISCONNECTED" 

PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: IF 16 NOT COMPLETE 

ERROR: RIGHT GEN. NOT ON 

RULE: NEED ELECT. PWR TO START PORT ENG. 

MEASUREMENT: 

EVENT 24 - MANDATORY 
SEQUENCE: 16,24 
TIME: N/A 



STEP NO. 8 

DESCRIPTION: CRANK LEFT ENGINE TO PRESSURIZE COMBINED HYD. PRESS. 

CONTINGENCIES: STEP 7 COMPLETE 

EVENTS: 25. ENGINE CRANK - LEFT 

26. COMB. HYD. PRESS -> 3000 

27. ENGINE CRANK - OFF 

ISFs end RELATED INFORMATION: 

IDS DISPLAY CONTROL & FORMATTING 

DISPUY UPDATE: "(TIME) ENG. CRANK LEFT /OFF" 

PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: 27 OCCURS BEFORE 26 
ERROR: INVALID TEST 

RULE: COMBINED HYDRAULIC PRESS MIN, 3000 PS I FOR VALID 

CHECK 
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MEASUREMENT: 

EVENTS 25,27 - MANDATORY 
SEQUENCE: 25.26,27 
TIME: N/A 



STEP NO. 9 

DESCRIPTION: CHECK HYDRAULIC TRANSFER PUMP 

CONTINGENCIES: STEP 8 COMPLETE 

28. COMB HYD PRESS > 2100 PSI 

29. HYD. TRANS. SW. - NORMAL 

30. COMB. HYD. PRESS - 2400-2600 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPIAY UPDATE: "(TIME) HYD TRANS SW NORMAL " 
PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: IF HYD PRESS < 2000 PSI 

ERROR: INVALID HYD PRESS CHECK 

RULE: MAINTAIN AT LAST 2100 PSI COMB HYD 

DISCREPANCY: IF EMERG HYD SW (TRANSIT) 
ERROR: SWITCH ERROR 

RULE: BI DI SW. FOR TRANS. CHK 

MEASUREMENT: 

EVENTS 29 - MANDATORY 
SEQUENCE: 28,29 
TIME: N/A 

STEP NO. 10 

DESCRIPTION: HYDRAULIC TRANSFER SWITCH TO SHUTOFF 

CONTINGENCIES: STEP 9 COMPLETE 

^^NTS: 32. HYD. TRANS. PUMP - SHUTOFF 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) HYD RANS PUMP SHUTOFF" 
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PROCEDURES MONITORING 



DIAGNOSTICS: 

DISCREPANCY: IF EMERG HYD SW (TRANSIT) 

ERROR: SWITCH ERROR 

ROLE: BI DI SW. FOR TRANS. CHK 

MEASUREMENT: 

EVENT 32 - MANDATORY 
SEQUENCE : N/A 
TIME: N/A 



STEP NO. 11 

DESCRIPTION: ENGINE CRANK TO LEFT ENG. TO START. 

CONTINGENCIES: RIGHT TO ENG 63 - 74% RPM 

EVENTS: 33. ENGINE CRANK - LEFT 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) ENGINE CRANK LEFT " 

PROCEDURES MONITORING 

DIAGNOSTICS: 

DISCREPANCY: IF ENG CRANK SW - R 

ERROR: SWITCH POSITION ERROR 

RULE: ENG CRANK TO LEFT 

MEASUREMENT: 

EVENT 33 ~ MANDATORY 
SEQUENCE: 32,33 
TIME: N/A 



STEP NO. 12 
DESCRIPTION: 
CONTINGENCIES: 
EVENTS: 



LEFT THROTTLE IDLE AT 22% FOR IGNITION. 
STEP 11 COMPLETE 

34. RPM -> 22% 

35. LEFT THROTTLE - IDLE 
36 . ENG . CRANK - OFF 

37. RPM - 50% 

38. L OVSP/VALVE LT - OUT 
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39. L GEN LT - OUT 

40. L FUEL PRESS LT - OUT 

41. LEFT TIT < 750 

ISFs and RELATED INFORMATION: 

ICS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: EVENTS 35 THRU 41 UPDATE 

PROCEDURES MONITORING 

DIAGNOSTICS : 

DISCREPANCY: IF 35 < 34 THEN : 

ERROR: THROTTLE IDLE BEFORE RPM 22% 

RULE: THROTTLE IDLE AFTER RPM « 22% 

DISCREPANCY: IF L TIT > 750 THEN: 
ERROR: L TIT - (VALUE) 

RULE: MAX START TEMP - 750 

MEASUREMENT: 

EVENT 35 - MANDATORY 
EVENT 41 - CRITICAL 
CRITICAL SEQUENCE: 34,35 
CRITICAL SEQUENCE: 36.37 
TIME: N/A 

STEP NO. 13 

DESCRIPTION: IDLE ENGINE INSTRUMENTS CHECK 

CONTINGENCIES: LEFT THROTTLE IDLE 

EVENTS: 42. L RPM - 63% - 74% 

43. L TIT - 600 +/■ 150 

4A. L P/F - 1000 +/- 200 

45 . L NOZZLE - 5 

46. L PLT HYD. - 3000 4-/- 175 

ISFs and RELATED INFORMATION: 

ICS DISPUY CONTROL & FORMATTING 

DISPLAY UPDATE: ONLY FOR DIAGNOSTICS 
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PROCEDURES MONITORING 

DIAGNOSTICS: 

DISCI^EPANCY: IF 42 45 NOT EQUAL RANGE THEN : 

ERROR: DEVICE (NAME) - (VALUE) 

RULE: DEVICE (NAME) (RANGE) NORMAL 

MEASUREMENT: 

EVENT : N/A 
SEQUENCE: N/A 
TIME : N/A 

STEP NO. U 

DESCRIPTION: DISCONNECT EXTERNAL AIR, 

CONTINGENCIES: L&R RPM ■■ 63 - 74% REM 

EVENTS: 47. EXTERNAL AIR - DISCONNECTED 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) EXT. AIR DISCONNECTED" 
PROCEDURES MONITORING 

DIAGNOSTICS: N/A 

MEASUREMENT: 

EVENT 47 - MANDATORY 
SEQUENCE: N/A 
TIME: N/A 

STEP NO. 15 

DESCRIPTION: HYDRAULIC TRANSFER PUMP TO NORMAL 

CONTINGENCIES: L&R HYD PSI - 3000 PSI 

EVENTS: 48. HYDRAULIC TRANSFER PUMP - NORMAL 

ISFs and RELATED INFORMATION: 

lOS DISPLAY CONTROL & FORMATTING 

DISPLAY UPDATE: "(TIME) HYD TRANS PUMP NORMAL" 
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PROCEDURES MONItORING 



DIAGNOSTICS : 

ERROR: 
RULE: 



IF EMERG FLT HYD SU (TRANSIT) 
WITHIN 30 SEC OF AIR DISCONNECT 
SWITCH ERROR 
BI DI PUMP TO NORMAL 



MEASUREMENT: 

EVENT 48 - MANDATORY 

TIME: TIME FOR TOTAL TIME TO COMPLETE THE TASK MODULE. 
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